-- Logs begin at Wed 2022-04-06 12:13:31 UTC, end at Wed 2022-04-06 13:13:54 UTC. -- Apr 06 12:39:45.021291 dv-cinder-836769-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 06 12:39:45.032301 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 06 12:39:45.036203 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Apr 6 12:39:45 2022] *** Apr 06 12:39:45.036203 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 06 12:39:45.036203 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 06 12:39:45.036203 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: nodename: dv-cinder-836769-2-iscsi Apr 06 12:39:45.036203 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: machine: x86_64 Apr 06 12:39:45.036203 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: clock source: unix Apr 06 12:39:45.036203 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: pcre jit disabled Apr 06 12:39:45.036203 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: detected number of CPU cores: 4 Apr 06 12:39:45.036203 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: current working directory: / Apr 06 12:39:45.036690 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: detected binary path: /usr/bin/uwsgi-core Apr 06 12:39:45.036690 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: your processes number limit is 47680 Apr 06 12:39:45.036690 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: your memory page size is 4096 bytes Apr 06 12:39:45.036690 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: detected max file descriptor number: 2048 Apr 06 12:39:45.036690 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: lock engine: pthread robust mutexes Apr 06 12:39:45.036690 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: thunder lock: enabled Apr 06 12:39:45.037015 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 06 12:39:45.037015 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 06 12:39:45.088671 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: Python main interpreter initialized at 0x55ce687e79c0 Apr 06 12:39:45.088671 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: python threads support enabled Apr 06 12:39:45.088671 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: your server socket listen backlog is limited to 100 connections Apr 06 12:39:45.088671 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: your mercy for graceful operations on workers is 90 seconds Apr 06 12:39:45.089229 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: mapped 403077 bytes (393 KB) for 2 cores Apr 06 12:39:45.089229 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: *** Operational MODE: preforking *** Apr 06 12:39:45.096324 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: *** uWSGI is running in multiple interpreter mode *** Apr 06 12:39:45.096324 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: spawned uWSGI master process (pid: 86163) Apr 06 12:39:45.096324 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: spawned uWSGI worker 1 (pid: 86175, cores: 1) Apr 06 12:39:45.096324 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: spawned uWSGI worker 2 (pid: 86176, cores: 1) Apr 06 12:39:45.096324 dv-cinder-836769-2-iscsi devstack@keystone.service[86163]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 06 12:39:45.089641 dv-cinder-836769-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 06 12:39:50.996174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 12:39:50.996174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: from cryptography.utils import int_from_bytes Apr 06 12:39:50.997219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 12:39:50.997219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: from cryptography.utils import int_from_bytes Apr 06 12:39:51.050201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 06 12:39:51.050454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 06 12:39:51.050575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] command line args: [] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 06 12:39:51.050900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 06 12:39:51.051044 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ================================================================================ {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 06 12:39:51.051551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] admin_token = **** {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.051810 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] config_dir = [] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.051966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.052191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] config_source = [] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.052320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] debug = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.052541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] list_limit = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] log_config_append = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] log_dir = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] log_file = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.056913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.057556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.057556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.057556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.057556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.057556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.057556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.057556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.060132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.060132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.060132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] publish_errors = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.060132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.060132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.060132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.060132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.060132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.060132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] standard_threads = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.062706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.062706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.062706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.062706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] use_journal = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.062706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] use_json = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.062706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] use_stderr = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.062706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] use_syslog = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.062706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:51.062706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.065497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.065497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.065497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.065497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.065497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.065497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.065497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.065497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.065497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.067539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.067539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.067539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.067539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.067539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.067539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.067539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.067539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.067539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.069269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.069269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.069269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.069269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.069269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.069269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.069269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.069269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.069269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.071187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.071187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.071187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.071187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.071187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.071187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.071187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.071187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.071187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.073009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.073009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.073009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.073009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.073009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.073009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.073009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.073009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.073009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.074858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.074858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.074858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.074858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.074858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.074858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.074858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.074858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.076367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.076367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.076367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.076367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.076367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.076367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.077547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.077547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.077547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.077547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.077547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.078683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.078683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.078683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.078683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.078683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.080148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.080148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.080148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.080992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.080992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.080992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.081607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.081607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.082020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.082020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.082428 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.082428 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.082830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.082830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.083220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.083434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.083652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.083872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.084080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.084347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.084623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.084832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.085051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.085268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.085472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.085705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.085909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.086116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.086345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.086560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.086764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.086984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.087232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.087479 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.087706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] auth.external = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.087919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.088228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.088452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.088693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] auth.password = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.088939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] auth.token = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.089261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.089471 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.089740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.089947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.090170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.090376 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.090599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.090803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] credential.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.091059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.091314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.091564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.091807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.092059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.092299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.092577 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.092836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.093083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.093343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.093658 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.093910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.094180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.094426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.094691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.095151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] federation.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.095516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.095892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.096153 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.096378 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.096637 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.096906 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.097126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.099445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.099445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.099445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.099445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.099445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.099445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.099445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.099445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.099445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.102260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.102260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.102260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.102260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.102260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.102260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.102260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.102260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.102260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.105041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.105041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.105041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.105041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.105041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.105041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.105041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.105041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.105041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.107054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.107054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.107054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.107054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.107054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.107054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.107054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.107054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.107054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.108918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.108918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.108918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.108918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.108918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.108918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.108918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.108918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.108918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.110794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.110794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.110794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.110794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.110794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.110794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.110794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.110794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.110794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.112528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.112528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.112528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.112528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.112528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.112528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.112528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.112528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.112528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.114272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.114272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.114272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.114272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.114272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.114272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.114272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.114272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.115829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.115829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.115829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.115829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.115829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.115829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.115829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.117259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.117259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.117259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.117259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.117259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.117259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.118561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.118561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.118561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.118561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.118561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.119531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.119531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.119531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.119531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] resource.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.120314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.120314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.120314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.120314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.121114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.121114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.121114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.121722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.121722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.121722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] role.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.122319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] role.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.122319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.122720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.122720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.123114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.123320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.123554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.123780 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.123986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.124192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.124396 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.124616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.124826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.125070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.125323 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.125793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.126019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.126986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.127249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.127564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.127826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.128070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.128331 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.128595 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.128858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.129100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.129325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.129532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.129837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.130057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.130265 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.130491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.130726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.130957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.131195 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] token.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.131439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.131691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.131918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.132179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.132431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.132673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.132922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.133168 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.133420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.133680 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.133924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.134154 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.134401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.134655 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.134887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.135124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.135427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.135692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.connection = **** {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.135945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.136201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.136444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.136670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.136918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.137160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.137388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.137661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.137875 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.138100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.138356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.138616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.138828 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.139070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.139359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.139592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.139829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.140071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:51.140285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 06 12:39:51.171720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.172092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.172443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.181401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.211593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.211934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.268587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.320438 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.320878 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.393082 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.393476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.393833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.394186 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.394525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.394862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.418993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.419365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.419726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.420070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.420410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.420747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.421085 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.433630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.447371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.447733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.448081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.448423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.448763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.449111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.449452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:51.467194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.467380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 12:39:51.467727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.468057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 12:39:51.468342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.468593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.468832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.469090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.480390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.480660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.480929 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.481210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.489957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.493236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.493505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.493808 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.494092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.494493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.494762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.495042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.495318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.495570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.495898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.496216 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.523749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.525297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.525606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.530898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.531172 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.531449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.539273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.539576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.544235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.544521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.544803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.545083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.545366 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.545677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.545950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.546217 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.566054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.566319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.571039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.574715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.575007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.580774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.584387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.589699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.589999 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.590285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.590570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.590847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.591124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.610743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.611093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.711901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.712168 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.720380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.722130 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.722413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.725495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.725803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.726092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.726545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.726825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.740079 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.740360 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.740630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.740909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.741188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.741461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.741755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.760165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.763459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.766818 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.769245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.771117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.771402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.771695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.779228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.780776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.784797 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.785124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.785328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.785604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.794832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.795121 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.795401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.803743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:51.804026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.804308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.804586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.804859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.805139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.805420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.805717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.805988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.806361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.806643 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.806921 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.807187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.807459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:51.846694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce687e79c0 pid: 86176 (default app) Apr 06 12:39:51.850253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7c83-04bb-49eb-92ec-37e4a9c29d08 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:39:51.850545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7c83-04bb-49eb-92ec-37e4a9c29d08 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:39:51.850823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc7c83-04bb-49eb-92ec-37e4a9c29d08 None None] PATH_INFO: `/v3` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:39:51.855731 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Wed Apr 6 12:39:51 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:39:52.329981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 12:39:52.329981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: from cryptography.utils import int_from_bytes Apr 06 12:39:52.329981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 06 12:39:52.329981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: from cryptography.utils import int_from_bytes Apr 06 12:39:52.382807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 06 12:39:52.383210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 06 12:39:52.383459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] command line args: [] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 06 12:39:52.383864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 06 12:39:52.384161 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ================================================================================ {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 06 12:39:52.384552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] admin_token = **** {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.384927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] config_dir = [] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.385244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.385633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] config_source = [] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.385887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] debug = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.386261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.386682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.386975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.387370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.387747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.388116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] list_limit = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.388422 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] log_config_append = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.388728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.389031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] log_dir = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.389338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] log_file = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.389733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.390121 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.390502 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.390893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.391219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.391536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.392454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.392859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.393361 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.393759 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.394126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.394488 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.394909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.395286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.395697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.396314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.396606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] publish_errors = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.396971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.397323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.397651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.398030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.398389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.398763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] standard_threads = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.399175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.399563 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.399863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.400200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] use_journal = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.400500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] use_json = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.400807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] use_stderr = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.401109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] use_syslog = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.401476 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 06 12:39:52.401937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.402306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.402698 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.403093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.403482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.403851 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.404306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.404633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.405021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.405414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.405838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.406232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.406616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.407008 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.407419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.408469 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.408847 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.409242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.409675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.410065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.410440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.410839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.411246 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.411642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.412030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.412398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.412771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.413143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.413518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.413944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.414329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.414695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.415143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.415541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.415930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.416305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.416691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.417059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.417430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.417862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.418234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.418601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.418967 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.419334 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.419708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.420101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.420468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.420841 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.421206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.421617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.421985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.422382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.422748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.423147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.423522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.423897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.424273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.424645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.425012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.425411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.425823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.426448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.426824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.427224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.427603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.428009 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.428365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.428738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.429147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.429531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.429948 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.430331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.430706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.431086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.431468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.431860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.432236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.432612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.432994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.433368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.433782 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.434168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.434543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.434917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.435311 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.435690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.436080 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.436455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.436835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.437206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.437685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.438011 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.438386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.439283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.439652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.440065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.440410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.440786 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.441165 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.441552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.441956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.442346 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.442742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.443116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.443490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] auth.external = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.443857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.444295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.444669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.445052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] auth.password = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.445437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] auth.token = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.445855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.446229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.446616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.446980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.447363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.447743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.448116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.448490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] credential.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.448993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.449375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.449797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.450189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.450577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.450950 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.451349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.451742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.452114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.452507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.452929 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.453339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.453779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.454167 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.455118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.455494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] federation.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.455884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.456276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.456662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.457031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.457417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.457818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.458223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.458597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.458987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.459360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.459743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.460117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.460512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.460899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.461281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.461697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.462091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.462457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.462844 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.463235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.463620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.463985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.464352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.464721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.465111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.465497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.465914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.466320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.466709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.467116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.467534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.467911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.468279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.468655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.469020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.469399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.469803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.470381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.470746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.471259 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.471547 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.471953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.472331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.472717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.473101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.473467 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.473879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.474254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.474629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.475001 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.475384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.475755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.476126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.476522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.476914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.477281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.477682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.478070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.478455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.478835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.479209 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.479585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.479950 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.480324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.480720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.481090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.481472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.481892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.482281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.482652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.483014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.483395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.483766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.484138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.484500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.484891 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.485277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.489802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.490126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.490416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.490654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.490940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.491196 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.491454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.491684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.491913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.492144 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.492404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.492651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.492915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.493171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.493424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.493691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.493916 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.494136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.494389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.494609 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.494826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.495071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.495296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] resource.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.495557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.495793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.496010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.496271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.496524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.496745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.496995 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.497232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.497481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.497763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] role.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.497978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] role.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.498207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.498457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.498709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.498956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.499292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.499551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.499769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.500031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.500263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.500483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.500698 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.500926 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.501887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.502137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.502420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.502662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.502883 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.503183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.503408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.503639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.503857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.504103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.504359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.504600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.504837 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.505075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.505295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.505551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.505827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.506069 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.506296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.506543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.506774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.506997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] token.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.507216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.507434 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.507645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.507949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.508191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.508410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.508628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.508849 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.509070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.509302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.509521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.509778 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.509998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.510218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.510436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.510668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.510953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.511222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.connection = **** {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.511479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.511712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.511925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.512153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.512375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.512608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.512823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.513044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.513301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.513528 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.513798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.514037 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.514260 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.514481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.514715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.514932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.515155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.515388 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 06 12:39:52.515606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 06 12:39:52.541330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.541709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.541950 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.552261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.571401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.571695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.609444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.647640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.649766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.693936 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.694296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.694501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.694696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.694910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.695103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.708834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.709155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.709395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.709661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.709661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.710189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.710189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.718042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.721061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.721317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.721696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.721918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.722132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.722323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.722529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 06 12:39:52.733082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.733377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 12:39:52.733707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.733923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 06 12:39:52.734119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.734322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.734582 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.734985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.746283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.746666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.746893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.747112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.758226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.761649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.761928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.762202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.762484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.762778 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.763046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.763310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.763576 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.763840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.764114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.764376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.792845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.794544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.794819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.800285 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.800551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.800827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.809237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.809669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.815079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.815432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.815630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.815916 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.816182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.816465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.816728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.817007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.836935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.837348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.841844 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.845621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.845917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.851050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.854660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.858293 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.858585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.858862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.859151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.859421 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.859765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.880282 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.880584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.880831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.881087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.889115 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.890840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.891109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.894318 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.894576 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.894854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.895149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.895417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.908580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.908864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.909128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.909401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.909705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.909987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.910255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.928796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.932078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.935415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.937032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.939364 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.939639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.939923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.947228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.948836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.952083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.952361 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.952624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.952886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.962269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.962556 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.962833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.970758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 06 12:39:52.971246 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.971477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.971674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.971867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.972090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.972331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.972607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.972971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.973236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.973518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.973810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.974074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:52.974331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 06 12:39:53.013291 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55ce687e79c0 pid: 86175 (default app) Apr 06 12:40:00.274321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f327-16e0-4904-84ed-85179de041ac None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:00.275193 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f327-16e0-4904-84ed-85179de041ac None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:00.275193 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9f327-16e0-4904-84ed-85179de041ac None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:00.276702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:00.286485 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa2004-8a78-4478-ab62-9e028cf9293b None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:00.287437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa2004-8a78-4478-ab62-9e028cf9293b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:00.287437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa2004-8a78-4478-ab62-9e028cf9293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:00.423135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG oslo_db.sqlalchemy.engines [None req-27aa2004-8a78-4478-ab62-9e028cf9293b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 12:40:00.638063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG passlib.handlers.bcrypt [None req-27aa2004-8a78-4478-ab62-9e028cf9293b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86175) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 06 12:40:00.638388 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG passlib.handlers.bcrypt [None req-27aa2004-8a78-4478-ab62-9e028cf9293b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86175) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 06 12:40:00.705583 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-27aa2004-8a78-4478-ab62-9e028cf9293b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:00.707256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-27aa2004-8a78-4478-ab62-9e028cf9293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:00.870600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 589 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 06 12:40:01.020294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f327-16e0-4904-84ed-85179de041ac None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:01.057255 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG oslo_db.sqlalchemy.engines [None req-71e9f327-16e0-4904-84ed-85179de041ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 06 12:40:01.204565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9f327-16e0-4904-84ed-85179de041ac None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:01.208854 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcd300-cac6-4e17-8ae2-f9e355288f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:01.209520 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcd300-cac6-4e17-8ae2-f9e355288f05 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:01.209830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcd300-cac6-4e17-8ae2-f9e355288f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:01.210108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcd300-cac6-4e17-8ae2-f9e355288f05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:01.218997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcd300-cac6-4e17-8ae2-f9e355288f05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:01.271043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.common.rbac_enforcer.enforcer [None req-31bcd300-cac6-4e17-8ae2-f9e355288f05 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 06 12:40:01.271297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcd300-cac6-4e17-8ae2-f9e355288f05 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:01.281490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1324 bytes} [Wed Apr 6 12:40:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 12:40:01.288793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa2004-8a78-4478-ab62-9e028cf9293b None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:01.306123 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa2004-8a78-4478-ab62-9e028cf9293b None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:01.310455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d7e0e-8649-4536-9c80-1ed3e92e38f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:01.311575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7e0e-8649-4536-9c80-1ed3e92e38f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:01.311859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7e0e-8649-4536-9c80-1ed3e92e38f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:01.312144 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d7e0e-8649-4536-9c80-1ed3e92e38f2 admin admin] PATH_INFO: `/v3/projects/0ae146b1346144a8a304973b35877975` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:01.314328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d7e0e-8649-4536-9c80-1ed3e92e38f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=0ae146b1346144a8a304973b35877975)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:01.364715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6d7d7e0e-8649-4536-9c80-1ed3e92e38f2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 06 12:40:01.365059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d7e0e-8649-4536-9c80-1ed3e92e38f2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:01.370127 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 2/5] 10.222.0.23 () {56 vars in 1207 bytes} [Wed Apr 6 12:40:01 2022] GET /identity/v3/projects/0ae146b1346144a8a304973b35877975 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:03.658880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef329c-e96a-42fa-ad67-1681ebe8d09e None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:03.659395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef329c-e96a-42fa-ad67-1681ebe8d09e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:03.659395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef329c-e96a-42fa-ad67-1681ebe8d09e None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:03.663425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 4/6] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:40:03.668789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddb8b5-f86b-41df-a838-0449af8e6c32 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:03.669222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddb8b5-f86b-41df-a838-0449af8e6c32 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:03.669460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddb8b5-f86b-41df-a838-0449af8e6c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:03.688826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d7ddb8b5-f86b-41df-a838-0449af8e6c32 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:03.690392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d7ddb8b5-f86b-41df-a838-0449af8e6c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:03.698097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 06 12:40:03.720099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef329c-e96a-42fa-ad67-1681ebe8d09e None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:03.731749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef329c-e96a-42fa-ad67-1681ebe8d09e None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:03.738792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf2aa3-3108-4753-84e3-e5f3337f6ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:03.739433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf2aa3-3108-4753-84e3-e5f3337f6ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:03.739715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf2aa3-3108-4753-84e3-e5f3337f6ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:03.739988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf2aa3-3108-4753-84e3-e5f3337f6ac5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:03.747699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf2aa3-3108-4753-84e3-e5f3337f6ac5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:03.749500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf2aa3-3108-4753-84e3-e5f3337f6ac5 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:03.758440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1324 bytes} [Wed Apr 6 12:40:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 12:40:03.765075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddb8b5-f86b-41df-a838-0449af8e6c32 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:03.774637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddb8b5-f86b-41df-a838-0449af8e6c32 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:03.778989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefd45b-31c9-472e-8a61-196be595e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:03.779848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefd45b-31c9-472e-8a61-196be595e1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:03.780133 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefd45b-31c9-472e-8a61-196be595e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:03.780409 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefd45b-31c9-472e-8a61-196be595e1f0 admin admin] PATH_INFO: `/v3/users/3e20a973b647478db16f26c4e132ad3b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:03.781843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefd45b-31c9-472e-8a61-196be595e1f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e20a973b647478db16f26c4e132ad3b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:03.783711 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefd45b-31c9-472e-8a61-196be595e1f0 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:03.785273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 4/9] 10.222.0.23 () {56 vars in 1198 bytes} [Wed Apr 6 12:40:03 2022] GET /identity/v3/users/3e20a973b647478db16f26c4e132ad3b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:06.180151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034525-3d21-4aba-be53-58761cb72f81 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:06.180691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034525-3d21-4aba-be53-58761cb72f81 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:06.180691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49034525-3d21-4aba-be53-58761cb72f81 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:06.182072 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:06.187057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcf7db-9c54-4817-b9b5-7d592d852ead None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:06.187472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcf7db-9c54-4817-b9b5-7d592d852ead None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:06.187635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbcf7db-9c54-4817-b9b5-7d592d852ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:06.199129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02157588-5969-4589-aa90-806e5f2bb78d None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:06.199411 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02157588-5969-4589-aa90-806e5f2bb78d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:06.199683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02157588-5969-4589-aa90-806e5f2bb78d None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:06.200984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 7/11] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:40:06.205773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-9dbcf7db-9c54-4817-b9b5-7d592d852ead None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:06.206503 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc228b-42cf-46f2-bd01-3c9c4c94a8be None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:06.206788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc228b-42cf-46f2-bd01-3c9c4c94a8be None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:06.206966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9dbcf7db-9c54-4817-b9b5-7d592d852ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:06.207058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc228b-42cf-46f2-bd01-3c9c4c94a8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:06.246081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG passlib.handlers.bcrypt [None req-51bc228b-42cf-46f2-bd01-3c9c4c94a8be None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86176) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 06 12:40:06.246499 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG passlib.handlers.bcrypt [None req-51bc228b-42cf-46f2-bd01-3c9c4c94a8be None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86176) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 06 12:40:06.285269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 5/12] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:06.293734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-51bc228b-42cf-46f2-bd01-3c9c4c94a8be None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:06.295309 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-51bc228b-42cf-46f2-bd01-3c9c4c94a8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:06.308772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcf7db-9c54-4817-b9b5-7d592d852ead None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:06.392545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:06.405272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbcf7db-9c54-4817-b9b5-7d592d852ead None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:06.414531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc228b-42cf-46f2-bd01-3c9c4c94a8be None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:06.438273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80d247-362c-400a-85f8-5a4c7a809679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:06.439000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80d247-362c-400a-85f8-5a4c7a809679 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:06.439286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80d247-362c-400a-85f8-5a4c7a809679 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:06.439564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80d247-362c-400a-85f8-5a4c7a809679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:06.450292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80d247-362c-400a-85f8-5a4c7a809679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:06.457830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-aa80d247-362c-400a-85f8-5a4c7a809679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:40:06.459057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 6/14] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:40:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:40:06.464643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80d247-362c-400a-85f8-5a4c7a809679 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:06.509394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc228b-42cf-46f2-bd01-3c9c4c94a8be None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:06.543391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196ba29-7417-46ae-86ef-a3f5364a9b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:06.544275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196ba29-7417-46ae-86ef-a3f5364a9b28 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:06.544568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196ba29-7417-46ae-86ef-a3f5364a9b28 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:06.544847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196ba29-7417-46ae-86ef-a3f5364a9b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:06.558144 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80d247-362c-400a-85f8-5a4c7a809679 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:06.589820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468393d-7f7a-4a3d-8b4b-27e5d2678a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:06.590474 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468393d-7f7a-4a3d-8b4b-27e5d2678a92 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:06.590759 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468393d-7f7a-4a3d-8b4b-27e5d2678a92 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:06.591061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468393d-7f7a-4a3d-8b4b-27e5d2678a92 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:06.591782 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468393d-7f7a-4a3d-8b4b-27e5d2678a92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:06.592088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468393d-7f7a-4a3d-8b4b-27e5d2678a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:06.593491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468393d-7f7a-4a3d-8b4b-27e5d2678a92 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:06.605381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 7/15] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:06.608492 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196ba29-7417-46ae-86ef-a3f5364a9b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:06.610330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196ba29-7417-46ae-86ef-a3f5364a9b28 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:06.610960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468393d-7f7a-4a3d-8b4b-27e5d2678a92 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:06.701729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 12:40:06.706474 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468393d-7f7a-4a3d-8b4b-27e5d2678a92 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:06.709141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196ba29-7417-46ae-86ef-a3f5364a9b28 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:06.737912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc9c36-d89d-47b7-938d-a2e0f5ed21aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:06.738773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc9c36-d89d-47b7-938d-a2e0f5ed21aa None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:06.739053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc9c36-d89d-47b7-938d-a2e0f5ed21aa None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:06.739322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc9c36-d89d-47b7-938d-a2e0f5ed21aa None admin] PATH_INFO: `/v3/users/3e20a973b647478db16f26c4e132ad3b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:06.740523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc9c36-d89d-47b7-938d-a2e0f5ed21aa None admin] RBAC: Authorizing `identity:get_user(user_id=3e20a973b647478db16f26c4e132ad3b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:06.742008 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc9c36-d89d-47b7-938d-a2e0f5ed21aa None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:06.743819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 8/17] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:06 2022] GET /identity/v3/users/3e20a973b647478db16f26c4e132ad3b => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:06.748906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc9c36-d89d-47b7-938d-a2e0f5ed21aa None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:06.799766 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196ba29-7417-46ae-86ef-a3f5364a9b28 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:06.832252 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fab76-b701-46fb-9e07-62f89c4a1f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:06.833038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fab76-b701-46fb-9e07-62f89c4a1f5d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:06.833324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fab76-b701-46fb-9e07-62f89c4a1f5d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:06.833632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fab76-b701-46fb-9e07-62f89c4a1f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:06.842131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc9c36-d89d-47b7-938d-a2e0f5ed21aa None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:06.851382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fab76-b701-46fb-9e07-62f89c4a1f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:06.852879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fab76-b701-46fb-9e07-62f89c4a1f5d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:06.869533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-2c0fab76-b701-46fb-9e07-62f89c4a1f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:40:06.870807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:40:06.873835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77473d-8732-4613-a635-0ca202741a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:06.874620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77473d-8732-4613-a635-0ca202741a7b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:06.874900 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77473d-8732-4613-a635-0ca202741a7b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:06.875171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77473d-8732-4613-a635-0ca202741a7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:06.876921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77473d-8732-4613-a635-0ca202741a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:06.877394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fab76-b701-46fb-9e07-62f89c4a1f5d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:06.878398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77473d-8732-4613-a635-0ca202741a7b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:06.879982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:06.885513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77473d-8732-4613-a635-0ca202741a7b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:06.971186 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fab76-b701-46fb-9e07-62f89c4a1f5d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:06.978640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77473d-8732-4613-a635-0ca202741a7b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:07.002902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6492d9-1a4d-4172-ad0c-bb3d738fbcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:07.003557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6492d9-1a4d-4172-ad0c-bb3d738fbcb2 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:07.003840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6492d9-1a4d-4172-ad0c-bb3d738fbcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:07.004115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6492d9-1a4d-4172-ad0c-bb3d738fbcb2 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:07.004838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6492d9-1a4d-4172-ad0c-bb3d738fbcb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:07.005148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6492d9-1a4d-4172-ad0c-bb3d738fbcb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:07.006601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6492d9-1a4d-4172-ad0c-bb3d738fbcb2 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:07.010651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69631a0-b66d-42ea-b7d9-4958124858ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:07.011296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69631a0-b66d-42ea-b7d9-4958124858ee None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:07.011581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69631a0-b66d-42ea-b7d9-4958124858ee None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:07.011857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69631a0-b66d-42ea-b7d9-4958124858ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:07.012688 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69631a0-b66d-42ea-b7d9-4958124858ee None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.domain.id=default, user.id=3e20a973b647478db16f26c4e132ad3b) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:07.012999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69631a0-b66d-42ea-b7d9-4958124858ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:07.014458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69631a0-b66d-42ea-b7d9-4958124858ee None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:07.021590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1322 bytes} [Wed Apr 6 12:40:06 2022] GET /identity/v3/role_assignments?user.id=3e20a973b647478db16f26c4e132ad3b&scope.domain.id=default&role.id=c158bb1781c44a03890992161076b84b => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:07.023937 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:09.544294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41294cc9-94e7-4a90-82c5-eeff81baceef None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:09.544836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41294cc9-94e7-4a90-82c5-eeff81baceef None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:09.544836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41294cc9-94e7-4a90-82c5-eeff81baceef None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:09.546628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:09.552706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c4b1-cb8f-46ac-b5fd-399d6e4ffbb1 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:09.553151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c4b1-cb8f-46ac-b5fd-399d6e4ffbb1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:09.553359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4c4b1-cb8f-46ac-b5fd-399d6e4ffbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:09.580212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-99e4c4b1-cb8f-46ac-b5fd-399d6e4ffbb1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:09.581422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-99e4c4b1-cb8f-46ac-b5fd-399d6e4ffbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:09.663987 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:09.698866 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41294cc9-94e7-4a90-82c5-eeff81baceef None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:09.819247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41294cc9-94e7-4a90-82c5-eeff81baceef None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:09.861965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8f50f-02b4-4d8d-835c-a3339d6d9ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:09.862767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8f50f-02b4-4d8d-835c-a3339d6d9ff2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:09.863055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8f50f-02b4-4d8d-835c-a3339d6d9ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:09.863333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8f50f-02b4-4d8d-835c-a3339d6d9ff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:09.876117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8f50f-02b4-4d8d-835c-a3339d6d9ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:09.883059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-a0c8f50f-02b4-4d8d-835c-a3339d6d9ff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:40:09.888797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 12/24] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:09.890071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c4b1-cb8f-46ac-b5fd-399d6e4ffbb1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:09.903340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db515c-1ed7-4e5d-93c7-106378575332 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:09.903645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db515c-1ed7-4e5d-93c7-106378575332 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:09.903899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db515c-1ed7-4e5d-93c7-106378575332 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:09.908989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:09.912179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ae8b-53bf-4e53-add6-71a2aec6d18d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:09.912470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ae8b-53bf-4e53-add6-71a2aec6d18d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:09.912747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80ae8b-53bf-4e53-add6-71a2aec6d18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:09.945999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-ce80ae8b-53bf-4e53-add6-71a2aec6d18d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:09.947127 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-ce80ae8b-53bf-4e53-add6-71a2aec6d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:10.060471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:10.091825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4c4b1-cb8f-46ac-b5fd-399d6e4ffbb1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:10.105032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80ae8b-53bf-4e53-add6-71a2aec6d18d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:10.150819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7bd8b-cfe4-45e0-8b1d-0ed537422d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:10.151541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7bd8b-cfe4-45e0-8b1d-0ed537422d58 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:10.151831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7bd8b-cfe4-45e0-8b1d-0ed537422d58 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:10.152109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7bd8b-cfe4-45e0-8b1d-0ed537422d58 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:10.152869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7bd8b-cfe4-45e0-8b1d-0ed537422d58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:10.153180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7bd8b-cfe4-45e0-8b1d-0ed537422d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:10.154639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7bd8b-cfe4-45e0-8b1d-0ed537422d58 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:10.178223 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 13/27] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:10.185730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7bd8b-cfe4-45e0-8b1d-0ed537422d58 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:10.280045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80ae8b-53bf-4e53-add6-71a2aec6d18d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:10.344556 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a639a0-c0fa-4fb2-b3c4-9849e65bd2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:10.345693 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a639a0-c0fa-4fb2-b3c4-9849e65bd2be None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:10.346182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a639a0-c0fa-4fb2-b3c4-9849e65bd2be None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:10.346854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a639a0-c0fa-4fb2-b3c4-9849e65bd2be None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:10.348384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a639a0-c0fa-4fb2-b3c4-9849e65bd2be None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:10.351175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a639a0-c0fa-4fb2-b3c4-9849e65bd2be None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:10.380102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7bd8b-cfe4-45e0-8b1d-0ed537422d58 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:10.447666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b458b-14a8-4c41-86ee-6bd2eee86d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:10.448794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b458b-14a8-4c41-86ee-6bd2eee86d7f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:10.449245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b458b-14a8-4c41-86ee-6bd2eee86d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:10.449683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b458b-14a8-4c41-86ee-6bd2eee86d7f None admin] PATH_INFO: `/v3/users/3e20a973b647478db16f26c4e132ad3b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:10.455503 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b458b-14a8-4c41-86ee-6bd2eee86d7f None admin] RBAC: Authorizing `identity:get_user(user_id=3e20a973b647478db16f26c4e132ad3b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:10.457150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41b458b-14a8-4c41-86ee-6bd2eee86d7f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:10.460016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 14/28] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:10 2022] GET /identity/v3/users/3e20a973b647478db16f26c4e132ad3b => generated 247 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:10.464326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b458b-14a8-4c41-86ee-6bd2eee86d7f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:10.545470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 15/29] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Apr 6 12:40:10 2022] POST /identity/v3/roles => generated 219 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:40:10.555044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf220-93d1-446f-8795-e87caf1b2d9e None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:10.555326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf220-93d1-446f-8795-e87caf1b2d9e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:10.555609 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf220-93d1-446f-8795-e87caf1b2d9e None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:10.557463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:10.587022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d792-ddf1-4760-8234-c76447de901c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:10.587371 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d792-ddf1-4760-8234-c76447de901c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:10.587585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6d792-ddf1-4760-8234-c76447de901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:10.620131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-aae6d792-ddf1-4760-8234-c76447de901c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:10.621694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-aae6d792-ddf1-4760-8234-c76447de901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:10.669382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b458b-14a8-4c41-86ee-6bd2eee86d7f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:10.740781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 17/31] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:10.749142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37444-9842-4152-81d8-c0874164b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:10.749989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37444-9842-4152-81d8-c0874164b13a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:10.750272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37444-9842-4152-81d8-c0874164b13a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:10.751224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e37444-9842-4152-81d8-c0874164b13a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:10.758581 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e37444-9842-4152-81d8-c0874164b13a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:10.760120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e37444-9842-4152-81d8-c0874164b13a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:10.762246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 15/32] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:10.768734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d792-ddf1-4760-8234-c76447de901c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:10.797121 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37444-9842-4152-81d8-c0874164b13a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:10.923057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6d792-ddf1-4760-8234-c76447de901c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:10.963299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e37444-9842-4152-81d8-c0874164b13a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:10.971300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946ed07-e234-44ed-8e3f-90b9d0b22137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:10.972406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946ed07-e234-44ed-8e3f-90b9d0b22137 None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:10.972860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946ed07-e234-44ed-8e3f-90b9d0b22137 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:10.973296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946ed07-e234-44ed-8e3f-90b9d0b22137 None admin] PATH_INFO: `/v3/domains/default/users/3e20a973b647478db16f26c4e132ad3b/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:10.976604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946ed07-e234-44ed-8e3f-90b9d0b22137 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3e20a973b647478db16f26c4e132ad3b, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:10.978510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946ed07-e234-44ed-8e3f-90b9d0b22137 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:11.001275 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 18/33] 10.222.0.23 () {58 vars in 1361 bytes} [Wed Apr 6 12:40:10 2022] PUT /identity/v3/domains/default/users/3e20a973b647478db16f26c4e132ad3b/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:11.002968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914b34-beb5-4693-818d-4c4c1fdd07c3 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.003472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914b34-beb5-4693-818d-4c4c1fdd07c3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.003930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914b34-beb5-4693-818d-4c4c1fdd07c3 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.004681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee404f3e-3d33-45e1-992b-e3b7a35e99f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:11.005665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee404f3e-3d33-45e1-992b-e3b7a35e99f3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.006095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee404f3e-3d33-45e1-992b-e3b7a35e99f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.006460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee404f3e-3d33-45e1-992b-e3b7a35e99f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.006654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 19/34] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:11.012479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e08e-27d9-42d9-b124-0c8ba437d034 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.013799 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e08e-27d9-42d9-b124-0c8ba437d034 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.013799 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e08e-27d9-42d9-b124-0c8ba437d034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.024180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee404f3e-3d33-45e1-992b-e3b7a35e99f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:11.025959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee404f3e-3d33-45e1-992b-e3b7a35e99f3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:11.037416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-27b0e08e-27d9-42d9-b124-0c8ba437d034 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:11.039350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-27b0e08e-27d9-42d9-b124-0c8ba437d034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:11.051504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-ee404f3e-3d33-45e1-992b-e3b7a35e99f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:40:11.052546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 16/35] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:11.058582 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee404f3e-3d33-45e1-992b-e3b7a35e99f3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:11.135374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 20/36] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:11.142137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3294b-1d4d-461b-981c-2ca6b618f038 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.142137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3294b-1d4d-461b-981c-2ca6b618f038 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.142137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3294b-1d4d-461b-981c-2ca6b618f038 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.142137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 21/37] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:11.149116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bc28d-ef3d-4536-855a-3c98117631fb None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.149631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bc28d-ef3d-4536-855a-3c98117631fb None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.150132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bc28d-ef3d-4536-855a-3c98117631fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.177306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-395bc28d-ef3d-4536-855a-3c98117631fb None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:11.178997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-395bc28d-ef3d-4536-855a-3c98117631fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:11.199958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee404f3e-3d33-45e1-992b-e3b7a35e99f3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:11.238036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cda6af-3b48-43df-b659-7e56b063bf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:11.238977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda6af-3b48-43df-b659-7e56b063bf03 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.239408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda6af-3b48-43df-b659-7e56b063bf03 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.239821 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda6af-3b48-43df-b659-7e56b063bf03 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.240692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cda6af-3b48-43df-b659-7e56b063bf03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:11.241135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cda6af-3b48-43df-b659-7e56b063bf03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:11.242715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cda6af-3b48-43df-b659-7e56b063bf03 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:11.255308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 17/38] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:11.259355 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cda6af-3b48-43df-b659-7e56b063bf03 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:11.266316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 22/39] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:11.267270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bc28d-ef3d-4536-855a-3c98117631fb None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:11.385549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bc28d-ef3d-4536-855a-3c98117631fb None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:11.392214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cda6af-3b48-43df-b659-7e56b063bf03 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:11.426365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a8521-6e7f-4822-a735-7053c18bde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:11.427533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a8521-6e7f-4822-a735-7053c18bde00 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.427827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a8521-6e7f-4822-a735-7053c18bde00 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.428095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a8521-6e7f-4822-a735-7053c18bde00 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.429153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a8521-6e7f-4822-a735-7053c18bde00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:11.430836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a8521-6e7f-4822-a735-7053c18bde00 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:11.446464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63601131-ad15-4721-bf2c-2f57dffe2548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:11.447414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601131-ad15-4721-bf2c-2f57dffe2548 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.447798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601131-ad15-4721-bf2c-2f57dffe2548 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.448146 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63601131-ad15-4721-bf2c-2f57dffe2548 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.449451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63601131-ad15-4721-bf2c-2f57dffe2548 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:11.452444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63601131-ad15-4721-bf2c-2f57dffe2548 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:11.465043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 23/40] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:40:11 2022] POST /identity/v3/projects => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:11.466052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a8521-6e7f-4822-a735-7053c18bde00 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:11.592076 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 18/41] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Apr 6 12:40:11 2022] POST /identity/v3/roles => generated 225 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:11.665100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a8521-6e7f-4822-a735-7053c18bde00 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:11.717879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03aeee-3e1a-40bc-b682-bfc24178c9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:11.718580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03aeee-3e1a-40bc-b682-bfc24178c9a8 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.718868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03aeee-3e1a-40bc-b682-bfc24178c9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.719740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03aeee-3e1a-40bc-b682-bfc24178c9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.720598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03aeee-3e1a-40bc-b682-bfc24178c9a8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:11.722152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03aeee-3e1a-40bc-b682-bfc24178c9a8 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:11.748770 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 24/42] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Apr 6 12:40:11 2022] POST /identity/v3/roles => generated 223 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:11.773116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73eb4e-ff98-4723-81cd-df0111e1b045 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.773663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73eb4e-ff98-4723-81cd-df0111e1b045 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.773737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73eb4e-ff98-4723-81cd-df0111e1b045 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.775185 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 19/43] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:11.786337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78916c7-9988-4bae-8d0a-51ebef2ee53f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:11.786646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78916c7-9988-4bae-8d0a-51ebef2ee53f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:11.786904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78916c7-9988-4bae-8d0a-51ebef2ee53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:11.812998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e78916c7-9988-4bae-8d0a-51ebef2ee53f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:11.814881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e78916c7-9988-4bae-8d0a-51ebef2ee53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:11.903771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 25/44] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:11.929131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73eb4e-ff98-4723-81cd-df0111e1b045 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:12.037218 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73eb4e-ff98-4723-81cd-df0111e1b045 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:12.072012 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad454620-14b7-4d39-b9f8-cbdacab41c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:12.072812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454620-14b7-4d39-b9f8-cbdacab41c5a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:12.073097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454620-14b7-4d39-b9f8-cbdacab41c5a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:12.073374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454620-14b7-4d39-b9f8-cbdacab41c5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:12.074686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad454620-14b7-4d39-b9f8-cbdacab41c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:12.076266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad454620-14b7-4d39-b9f8-cbdacab41c5a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:12.077921 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 20/45] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:12.084187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78916c7-9988-4bae-8d0a-51ebef2ee53f None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:12.181435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78916c7-9988-4bae-8d0a-51ebef2ee53f None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:12.217264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20464a-2fb9-4cdf-bcdf-6dd342b0ebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:12.217961 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20464a-2fb9-4cdf-bcdf-6dd342b0ebd3 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:12.218252 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20464a-2fb9-4cdf-bcdf-6dd342b0ebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:12.218533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20464a-2fb9-4cdf-bcdf-6dd342b0ebd3 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:12.219395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20464a-2fb9-4cdf-bcdf-6dd342b0ebd3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:12.220860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20464a-2fb9-4cdf-bcdf-6dd342b0ebd3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:12.244370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 26/46] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:40:12 2022] POST /identity/v3/projects => generated 312 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:13.523193 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a10b-383c-416f-9a69-d1b01321241e None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:13.523711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a10b-383c-416f-9a69-d1b01321241e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:13.523791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a10b-383c-416f-9a69-d1b01321241e None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:13.525163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 21/47] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:13.530515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720667cb-5d81-4bf6-8ba7-cb1ac636c989 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:13.530917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720667cb-5d81-4bf6-8ba7-cb1ac636c989 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:13.531187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720667cb-5d81-4bf6-8ba7-cb1ac636c989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:13.549430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-720667cb-5d81-4bf6-8ba7-cb1ac636c989 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:13.550645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-720667cb-5d81-4bf6-8ba7-cb1ac636c989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:13.612020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 27/48] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:13.635448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02a10b-383c-416f-9a69-d1b01321241e None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:13.731009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02a10b-383c-416f-9a69-d1b01321241e None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:13.762517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a5590-45fd-40a7-9f72-6326ef477a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:13.763305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a5590-45fd-40a7-9f72-6326ef477a84 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:13.763592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a5590-45fd-40a7-9f72-6326ef477a84 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:13.763869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a5590-45fd-40a7-9f72-6326ef477a84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:13.775425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a5590-45fd-40a7-9f72-6326ef477a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:13.782846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-5e1a5590-45fd-40a7-9f72-6326ef477a84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:40:13.784045 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 22/49] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:13.789817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720667cb-5d81-4bf6-8ba7-cb1ac636c989 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:13.890543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720667cb-5d81-4bf6-8ba7-cb1ac636c989 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:13.924678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc690be-9a4b-4e72-b2c3-41c610d59764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:13.925353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc690be-9a4b-4e72-b2c3-41c610d59764 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:13.925690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc690be-9a4b-4e72-b2c3-41c610d59764 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:13.926221 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc690be-9a4b-4e72-b2c3-41c610d59764 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:13.926974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc690be-9a4b-4e72-b2c3-41c610d59764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:13.927284 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc690be-9a4b-4e72-b2c3-41c610d59764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:13.928678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc690be-9a4b-4e72-b2c3-41c610d59764 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:13.936579 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 28/50] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:13.942655 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a5590-45fd-40a7-9f72-6326ef477a84 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:14.047986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a5590-45fd-40a7-9f72-6326ef477a84 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:14.081673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88704e72-b3cf-493c-b5d7-87b795cf1800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:14.082564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88704e72-b3cf-493c-b5d7-87b795cf1800 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:14.082836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88704e72-b3cf-493c-b5d7-87b795cf1800 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:14.083125 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88704e72-b3cf-493c-b5d7-87b795cf1800 None admin] PATH_INFO: `/v3/users/3e20a973b647478db16f26c4e132ad3b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:14.084425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88704e72-b3cf-493c-b5d7-87b795cf1800 None admin] RBAC: Authorizing `identity:get_user(user_id=3e20a973b647478db16f26c4e132ad3b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:14.085937 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88704e72-b3cf-493c-b5d7-87b795cf1800 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:14.087563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 23/51] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:13 2022] GET /identity/v3/users/3e20a973b647478db16f26c4e132ad3b => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:14.092980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc690be-9a4b-4e72-b2c3-41c610d59764 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:14.201532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc690be-9a4b-4e72-b2c3-41c610d59764 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:14.237126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ce4cd-2f6c-4c7b-bc57-961fdbff4b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:14.237957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ce4cd-2f6c-4c7b-bc57-961fdbff4b1a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:14.238241 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ce4cd-2f6c-4c7b-bc57-961fdbff4b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:14.238513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ce4cd-2f6c-4c7b-bc57-961fdbff4b1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:14.239691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ce4cd-2f6c-4c7b-bc57-961fdbff4b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:14.241141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ce4cd-2f6c-4c7b-bc57-961fdbff4b1a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:14.242777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 29/52] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:14.248417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88704e72-b3cf-493c-b5d7-87b795cf1800 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:14.346213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88704e72-b3cf-493c-b5d7-87b795cf1800 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:14.378539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6ecf4-13bf-49a2-a985-a75b309872ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:14.379201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6ecf4-13bf-49a2-a985-a75b309872ad None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:14.379491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6ecf4-13bf-49a2-a985-a75b309872ad None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:14.379771 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6ecf4-13bf-49a2-a985-a75b309872ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:14.380608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6ecf4-13bf-49a2-a985-a75b309872ad None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.domain.id=default, user.id=3e20a973b647478db16f26c4e132ad3b) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:14.380924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6ecf4-13bf-49a2-a985-a75b309872ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:14.382436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6ecf4-13bf-49a2-a985-a75b309872ad None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:14.392357 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 24/53] 10.222.0.23 () {56 vars in 1322 bytes} [Wed Apr 6 12:40:14 2022] GET /identity/v3/role_assignments?user.id=3e20a973b647478db16f26c4e132ad3b&scope.domain.id=default&role.id=c158bb1781c44a03890992161076b84b => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:14.553415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b921cfa-918d-4afc-97ad-9855d2f26a17 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:14.553984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b921cfa-918d-4afc-97ad-9855d2f26a17 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:14.553984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b921cfa-918d-4afc-97ad-9855d2f26a17 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:14.555393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 30/54] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:14.561112 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6500c3-f570-46fb-bc13-83e2292cb738 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:14.561626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6500c3-f570-46fb-bc13-83e2292cb738 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:14.561707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6500c3-f570-46fb-bc13-83e2292cb738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:14.579796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-7a6500c3-f570-46fb-bc13-83e2292cb738 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:14.581306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7a6500c3-f570-46fb-bc13-83e2292cb738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:14.648661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 25/55] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:14.673276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b921cfa-918d-4afc-97ad-9855d2f26a17 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:14.768987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b921cfa-918d-4afc-97ad-9855d2f26a17 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:14.800252 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9181835-3a89-4dad-a1e0-89f376be9a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:14.801297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9181835-3a89-4dad-a1e0-89f376be9a06 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:14.801602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9181835-3a89-4dad-a1e0-89f376be9a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:14.801886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9181835-3a89-4dad-a1e0-89f376be9a06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:14.803052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9181835-3a89-4dad-a1e0-89f376be9a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:14.804550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9181835-3a89-4dad-a1e0-89f376be9a06 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:14.806116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 31/56] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:14.811546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6500c3-f570-46fb-bc13-83e2292cb738 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:14.901247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6500c3-f570-46fb-bc13-83e2292cb738 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:14.932841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4e18a-47b9-4304-aa01-06c8286d548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:14.933484 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4e18a-47b9-4304-aa01-06c8286d548e None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:14.933792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4e18a-47b9-4304-aa01-06c8286d548e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:14.934064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4e18a-47b9-4304-aa01-06c8286d548e None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:14.934770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4e18a-47b9-4304-aa01-06c8286d548e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:14.936243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4e18a-47b9-4304-aa01-06c8286d548e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:14.967753 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 26/57] 10.222.0.23 () {60 vars in 1140 bytes} [Wed Apr 6 12:40:14 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:40:17.269166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395af0-ab71-472d-8858-78e1491996c4 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:17.269728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395af0-ab71-472d-8858-78e1491996c4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:17.269909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64395af0-ab71-472d-8858-78e1491996c4 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:17.271301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 32/58] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:17.276499 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1ed8f-5039-4615-9aa9-0223d2d75836 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:17.276876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1ed8f-5039-4615-9aa9-0223d2d75836 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:17.277058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1ed8f-5039-4615-9aa9-0223d2d75836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:17.293771 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c9f1ed8f-5039-4615-9aa9-0223d2d75836 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:17.294942 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c9f1ed8f-5039-4615-9aa9-0223d2d75836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:17.359238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 27/59] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:17.384915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64395af0-ab71-472d-8858-78e1491996c4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:17.479796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64395af0-ab71-472d-8858-78e1491996c4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:17.511216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82213b-e054-4bfc-82e7-baee08050f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:17.511997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82213b-e054-4bfc-82e7-baee08050f34 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:17.512280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82213b-e054-4bfc-82e7-baee08050f34 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:17.512555 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82213b-e054-4bfc-82e7-baee08050f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:17.513745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82213b-e054-4bfc-82e7-baee08050f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:17.515192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82213b-e054-4bfc-82e7-baee08050f34 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:17.517039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 33/60] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:17.522475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1ed8f-5039-4615-9aa9-0223d2d75836 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:17.614240 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1ed8f-5039-4615-9aa9-0223d2d75836 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:17.645404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9e15e-87d4-443f-a177-3e4ff440890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:17.646087 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9e15e-87d4-443f-a177-3e4ff440890b None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:17.646375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9e15e-87d4-443f-a177-3e4ff440890b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:17.646653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9e15e-87d4-443f-a177-3e4ff440890b None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:17.647381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9e15e-87d4-443f-a177-3e4ff440890b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:17.648860 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9e15e-87d4-443f-a177-3e4ff440890b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:17.673551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 28/61] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:40:17 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:21.052201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bead04-a604-446f-8bcf-64dd2d7ed5fa None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.052758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bead04-a604-446f-8bcf-64dd2d7ed5fa None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.053028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bead04-a604-446f-8bcf-64dd2d7ed5fa None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.054907 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 34/62] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:21.060332 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4ad35-645f-41b2-bf50-11bed78e2b1d None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.061149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4ad35-645f-41b2-bf50-11bed78e2b1d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.061686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4ad35-645f-41b2-bf50-11bed78e2b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.086580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-45a4ad35-645f-41b2-bf50-11bed78e2b1d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:21.088141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-45a4ad35-645f-41b2-bf50-11bed78e2b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:21.161455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324f56-55e6-4ee0-ab2a-2b22210dd668 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.162104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324f56-55e6-4ee0-ab2a-2b22210dd668 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.162601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324f56-55e6-4ee0-ab2a-2b22210dd668 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.164164 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 35/63] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:40:21.172670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 29/64] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:21.175098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b862-b329-42ec-9146-570a50700b5d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.175597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b862-b329-42ec-9146-570a50700b5d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.176314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b862-b329-42ec-9146-570a50700b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.207109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-8669b862-b329-42ec-9146-570a50700b5d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:21.208682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8669b862-b329-42ec-9146-570a50700b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:21.226016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4ad35-645f-41b2-bf50-11bed78e2b1d None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:21.289836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 36/65] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:21.322438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b862-b329-42ec-9146-570a50700b5d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:21.431448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4ad35-645f-41b2-bf50-11bed78e2b1d None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:21.472638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b862-b329-42ec-9146-570a50700b5d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:21.491467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb02e75-b9a2-4a6a-8e80-ecd9aadb9631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:21.492617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02e75-b9a2-4a6a-8e80-ecd9aadb9631 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.493116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02e75-b9a2-4a6a-8e80-ecd9aadb9631 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.493600 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb02e75-b9a2-4a6a-8e80-ecd9aadb9631 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.504521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb02e75-b9a2-4a6a-8e80-ecd9aadb9631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:21.506824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f300b1-fc8d-4033-b993-36b5fc8553b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:21.507630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f300b1-fc8d-4033-b993-36b5fc8553b5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.507918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f300b1-fc8d-4033-b993-36b5fc8553b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.508197 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f300b1-fc8d-4033-b993-36b5fc8553b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.513025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-2fb02e75-b9a2-4a6a-8e80-ecd9aadb9631 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:40:21.514758 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 30/66] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:21.516859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0509-b33d-42b0-a59c-60023b6e7559 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.517358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0509-b33d-42b0-a59c-60023b6e7559 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.517917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0509-b33d-42b0-a59c-60023b6e7559 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.519664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 31/67] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:21.527049 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0509-b33d-42b0-a59c-60023b6e7559 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:21.527192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f300b1-fc8d-4033-b993-36b5fc8553b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:21.531947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-81f300b1-fc8d-4033-b993-36b5fc8553b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:21.533195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 37/68] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:40:21.534471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7769-6454-49df-9ad0-d6896b479264 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.534765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7769-6454-49df-9ad0-d6896b479264 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.535046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7769-6454-49df-9ad0-d6896b479264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.551652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-7c4b7769-6454-49df-9ad0-d6896b479264 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:21.553071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7c4b7769-6454-49df-9ad0-d6896b479264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:21.621423 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 38/69] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:21.622552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b7769-6454-49df-9ad0-d6896b479264 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:21.634324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0509-b33d-42b0-a59c-60023b6e7559 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:21.668449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e49558-a5ef-48ac-b6fb-79b91e13353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:21.669407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e49558-a5ef-48ac-b6fb-79b91e13353e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.669882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e49558-a5ef-48ac-b6fb-79b91e13353e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.670326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e49558-a5ef-48ac-b6fb-79b91e13353e None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.671373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e49558-a5ef-48ac-b6fb-79b91e13353e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:21.671894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e49558-a5ef-48ac-b6fb-79b91e13353e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:21.673502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e49558-a5ef-48ac-b6fb-79b91e13353e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:21.682536 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 32/70] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:21.683651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e49558-a5ef-48ac-b6fb-79b91e13353e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:21.727622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b7769-6454-49df-9ad0-d6896b479264 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:21.762085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc6672-d427-4334-a2d4-beab8df9b643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:21.762984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6672-d427-4334-a2d4-beab8df9b643 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.763416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6672-d427-4334-a2d4-beab8df9b643 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.763835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6672-d427-4334-a2d4-beab8df9b643 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.764727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc6672-d427-4334-a2d4-beab8df9b643 None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:21.765213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc6672-d427-4334-a2d4-beab8df9b643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:21.767212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc6672-d427-4334-a2d4-beab8df9b643 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:21.775691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 39/71] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:21.776493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc6672-d427-4334-a2d4-beab8df9b643 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:21.787604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e49558-a5ef-48ac-b6fb-79b91e13353e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:21.821164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b2c4e-3984-4877-b819-6c83d3085c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:21.822067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b2c4e-3984-4877-b819-6c83d3085c63 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.822360 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b2c4e-3984-4877-b819-6c83d3085c63 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.822639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b2c4e-3984-4877-b819-6c83d3085c63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.833040 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b2c4e-3984-4877-b819-6c83d3085c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:21.840321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-6e7b2c4e-3984-4877-b819-6c83d3085c63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:40:21.841711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 33/72] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:40:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:21.842751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95075e-e7c3-4463-a9e8-8ce7bdac8fb4 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.843197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95075e-e7c3-4463-a9e8-8ce7bdac8fb4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.843631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95075e-e7c3-4463-a9e8-8ce7bdac8fb4 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.844928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 34/73] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:21.845862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95075e-e7c3-4463-a9e8-8ce7bdac8fb4 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:21.880497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc6672-d427-4334-a2d4-beab8df9b643 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:21.912198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e1593-3ad1-4834-ae69-99b42f11c058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:21.913066 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e1593-3ad1-4834-ae69-99b42f11c058 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.913363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e1593-3ad1-4834-ae69-99b42f11c058 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.913669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e1593-3ad1-4834-ae69-99b42f11c058 None admin] PATH_INFO: `/v3/users/3e20a973b647478db16f26c4e132ad3b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.914877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e1593-3ad1-4834-ae69-99b42f11c058 None admin] RBAC: Authorizing `identity:get_user(user_id=3e20a973b647478db16f26c4e132ad3b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:21.916335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e1593-3ad1-4834-ae69-99b42f11c058 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:21.918146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 40/74] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:21 2022] GET /identity/v3/users/3e20a973b647478db16f26c4e132ad3b => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:21.918752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e1593-3ad1-4834-ae69-99b42f11c058 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:21.943521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95075e-e7c3-4463-a9e8-8ce7bdac8fb4 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:21.974881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313e36a-d07d-4674-a7d0-7da2827df83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:21.975751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313e36a-d07d-4674-a7d0-7da2827df83c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.976030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313e36a-d07d-4674-a7d0-7da2827df83c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.976302 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313e36a-d07d-4674-a7d0-7da2827df83c None admin] PATH_INFO: `/v3/users/12463e0931d04a7d9563aa3ed23c06af` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:21.990622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313e36a-d07d-4674-a7d0-7da2827df83c None admin] RBAC: Authorizing `identity:get_user(user_id=12463e0931d04a7d9563aa3ed23c06af)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:21.992100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313e36a-d07d-4674-a7d0-7da2827df83c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:21.993783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 35/75] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:21 2022] GET /identity/v3/users/12463e0931d04a7d9563aa3ed23c06af => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:21.995631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6115b-6814-48ac-af8e-8897ed928160 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:21.995923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6115b-6814-48ac-af8e-8897ed928160 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:21.996205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6115b-6814-48ac-af8e-8897ed928160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.012726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-74e6115b-6814-48ac-af8e-8897ed928160 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:22.013040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e1593-3ad1-4834-ae69-99b42f11c058 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:22.013940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-74e6115b-6814-48ac-af8e-8897ed928160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:22.048791 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c218ba-2972-483f-a16e-86085406b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:22.049970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c218ba-2972-483f-a16e-86085406b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.050469 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c218ba-2972-483f-a16e-86085406b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.051220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c218ba-2972-483f-a16e-86085406b4d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.052181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c218ba-2972-483f-a16e-86085406b4d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:22.052650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c218ba-2972-483f-a16e-86085406b4d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:22.055108 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c218ba-2972-483f-a16e-86085406b4d2 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:22.068156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 41/76] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:40:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:22.069251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77d7e0-b8ef-493a-ae95-d8a5585f2462 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.069545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77d7e0-b8ef-493a-ae95-d8a5585f2462 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.069843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77d7e0-b8ef-493a-ae95-d8a5585f2462 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.071061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 42/77] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:22.073645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77d7e0-b8ef-493a-ae95-d8a5585f2462 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:22.076828 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 36/78] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:22.077694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6115b-6814-48ac-af8e-8897ed928160 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:22.169501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6115b-6814-48ac-af8e-8897ed928160 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:22.176060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77d7e0-b8ef-493a-ae95-d8a5585f2462 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:22.202727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260855d-7708-47c3-8578-47b733e9dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:22.203443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260855d-7708-47c3-8578-47b733e9dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.203730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260855d-7708-47c3-8578-47b733e9dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.204004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260855d-7708-47c3-8578-47b733e9dcb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.208487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e1b9d-14ba-4ec2-b9fd-e2100d2315e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:22.209129 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e1b9d-14ba-4ec2-b9fd-e2100d2315e9 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.209415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e1b9d-14ba-4ec2-b9fd-e2100d2315e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.209725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e1b9d-14ba-4ec2-b9fd-e2100d2315e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.267109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260855d-7708-47c3-8578-47b733e9dcb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:22.268621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260855d-7708-47c3-8578-47b733e9dcb0 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:22.272187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e1b9d-14ba-4ec2-b9fd-e2100d2315e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:22.273676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e1b9d-14ba-4ec2-b9fd-e2100d2315e9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:22.361242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 37/79] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:22.362139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260855d-7708-47c3-8578-47b733e9dcb0 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:22.368581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 43/80] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:22.369734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9d8c1-764b-436e-b501-cadeedf81ab8 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.370022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9d8c1-764b-436e-b501-cadeedf81ab8 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.370295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9d8c1-764b-436e-b501-cadeedf81ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.387658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-afe9d8c1-764b-436e-b501-cadeedf81ab8 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:22.388867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-afe9d8c1-764b-436e-b501-cadeedf81ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:22.450646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 44/81] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:22.451192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9d8c1-764b-436e-b501-cadeedf81ab8 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:22.461546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260855d-7708-47c3-8578-47b733e9dcb0 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:22.494334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8664900-9981-4c55-814a-75bc7b2b5b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:22.495206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8664900-9981-4c55-814a-75bc7b2b5b75 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.495486 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8664900-9981-4c55-814a-75bc7b2b5b75 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.495756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8664900-9981-4c55-814a-75bc7b2b5b75 None admin] PATH_INFO: `/v3/users/12463e0931d04a7d9563aa3ed23c06af` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.496956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8664900-9981-4c55-814a-75bc7b2b5b75 None admin] RBAC: Authorizing `identity:get_user(user_id=12463e0931d04a7d9563aa3ed23c06af)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:22.498481 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8664900-9981-4c55-814a-75bc7b2b5b75 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:22.500160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 38/82] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:22 2022] GET /identity/v3/users/12463e0931d04a7d9563aa3ed23c06af => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:22.500911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8664900-9981-4c55-814a-75bc7b2b5b75 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:22.545154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9d8c1-764b-436e-b501-cadeedf81ab8 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:22.577716 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce1b1a-8482-496a-9f53-69d28bcb0757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:22.578594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce1b1a-8482-496a-9f53-69d28bcb0757 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.578958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce1b1a-8482-496a-9f53-69d28bcb0757 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.579229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce1b1a-8482-496a-9f53-69d28bcb0757 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.589242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce1b1a-8482-496a-9f53-69d28bcb0757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:22.596053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8664900-9981-4c55-814a-75bc7b2b5b75 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:22.596746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-5bce1b1a-8482-496a-9f53-69d28bcb0757 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:22.597988 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 45/83] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:22.598751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce1b1a-8482-496a-9f53-69d28bcb0757 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:22.629654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fa117-0d97-4a68-88bf-d2f038c20a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:22.630514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fa117-0d97-4a68-88bf-d2f038c20a16 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.630796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fa117-0d97-4a68-88bf-d2f038c20a16 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.631068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fa117-0d97-4a68-88bf-d2f038c20a16 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.632292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fa117-0d97-4a68-88bf-d2f038c20a16 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:22.633788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fa117-0d97-4a68-88bf-d2f038c20a16 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:22.635470 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 39/84] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:22 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:22.636220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fa117-0d97-4a68-88bf-d2f038c20a16 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:22.698707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce1b1a-8482-496a-9f53-69d28bcb0757 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:22.727514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fa117-0d97-4a68-88bf-d2f038c20a16 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:22.731426 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ddd3e-2a31-480b-abf2-1c32efe8a98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:22.732279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ddd3e-2a31-480b-abf2-1c32efe8a98b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.732564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ddd3e-2a31-480b-abf2-1c32efe8a98b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.732841 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ddd3e-2a31-480b-abf2-1c32efe8a98b None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.734061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ddd3e-2a31-480b-abf2-1c32efe8a98b None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:22.736660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ddd3e-2a31-480b-abf2-1c32efe8a98b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:22.738368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 46/85] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:22 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:22.739136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ddd3e-2a31-480b-abf2-1c32efe8a98b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:22.760162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e071f-7698-4238-92cf-d8c9d0da2817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:22.760954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e071f-7698-4238-92cf-d8c9d0da2817 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.761245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e071f-7698-4238-92cf-d8c9d0da2817 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.761524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e071f-7698-4238-92cf-d8c9d0da2817 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.762735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e071f-7698-4238-92cf-d8c9d0da2817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:22.764207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e071f-7698-4238-92cf-d8c9d0da2817 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:22.765909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 40/86] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:22.770375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e071f-7698-4238-92cf-d8c9d0da2817 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:22.838845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ddd3e-2a31-480b-abf2-1c32efe8a98b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:22.859563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e071f-7698-4238-92cf-d8c9d0da2817 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:22.870718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a5839-ba19-47bb-9786-af1e16d310f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:22.871353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a5839-ba19-47bb-9786-af1e16d310f8 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.871643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a5839-ba19-47bb-9786-af1e16d310f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.871915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a5839-ba19-47bb-9786-af1e16d310f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.891805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac907a-08f0-4769-bc18-7eec6c5f4af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:22.892467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac907a-08f0-4769-bc18-7eec6c5f4af3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:22.892754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac907a-08f0-4769-bc18-7eec6c5f4af3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:22.893032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac907a-08f0-4769-bc18-7eec6c5f4af3 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:22.893808 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac907a-08f0-4769-bc18-7eec6c5f4af3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:22.894120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac907a-08f0-4769-bc18-7eec6c5f4af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:22.895534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac907a-08f0-4769-bc18-7eec6c5f4af3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:22.903192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 41/87] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:22.903969 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac907a-08f0-4769-bc18-7eec6c5f4af3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:22.937514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a5839-ba19-47bb-9786-af1e16d310f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:22.939501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a5839-ba19-47bb-9786-af1e16d310f8 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:22.997934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac907a-08f0-4769-bc18-7eec6c5f4af3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:23.028865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afe8e-2c83-402c-b09f-d1908a683e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:23.029517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afe8e-2c83-402c-b09f-d1908a683e7c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:23.029829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afe8e-2c83-402c-b09f-d1908a683e7c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:23.030101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afe8e-2c83-402c-b09f-d1908a683e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:23.030925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88afe8e-2c83-402c-b09f-d1908a683e7c None admin] RBAC: Adding query filter params (role.id=9b6d2d07e37f449699fd25de81ee509a, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c, user.id=12463e0931d04a7d9563aa3ed23c06af) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:23.031934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88afe8e-2c83-402c-b09f-d1908a683e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:23.033372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88afe8e-2c83-402c-b09f-d1908a683e7c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:23.036421 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 47/88] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:23.054884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a5839-ba19-47bb-9786-af1e16d310f8 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:23.054963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 42/89] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:22 2022] GET /identity/v3/role_assignments?user.id=12463e0931d04a7d9563aa3ed23c06af&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:23.054963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afe8e-2c83-402c-b09f-d1908a683e7c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:23.138509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a5839-ba19-47bb-9786-af1e16d310f8 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:23.141398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afe8e-2c83-402c-b09f-d1908a683e7c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:23.175018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b89a1-e679-4399-8f51-4e2ead62f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:23.175696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b89a1-e679-4399-8f51-4e2ead62f600 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:23.176239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b89a1-e679-4399-8f51-4e2ead62f600 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:23.176345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc7f6-7ee8-4328-a88d-df5908c48777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:23.176518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b89a1-e679-4399-8f51-4e2ead62f600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:23.176966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc7f6-7ee8-4328-a88d-df5908c48777 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:23.177251 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc7f6-7ee8-4328-a88d-df5908c48777 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:23.177351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b89a1-e679-4399-8f51-4e2ead62f600 None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c, user.id=3e20a973b647478db16f26c4e132ad3b) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:23.177530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc7f6-7ee8-4328-a88d-df5908c48777 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:23.177713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b89a1-e679-4399-8f51-4e2ead62f600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:23.178293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acc7f6-7ee8-4328-a88d-df5908c48777 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:23.179226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b89a1-e679-4399-8f51-4e2ead62f600 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:23.179802 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acc7f6-7ee8-4328-a88d-df5908c48777 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:23.185473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 48/90] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:23 2022] GET /identity/v3/role_assignments?user.id=3e20a973b647478db16f26c4e132ad3b&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=c158bb1781c44a03890992161076b84b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:23.186193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b89a1-e679-4399-8f51-4e2ead62f600 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:23.215229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 43/91] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:40:23 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:23.216839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc7f6-7ee8-4328-a88d-df5908c48777 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:23.313445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b89a1-e679-4399-8f51-4e2ead62f600 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:23.337614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc7f6-7ee8-4328-a88d-df5908c48777 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:23.378195 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8b5d5-1424-428c-b0c1-a639a846b066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:23.379165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8b5d5-1424-428c-b0c1-a639a846b066 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:23.379460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8b5d5-1424-428c-b0c1-a639a846b066 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:23.379745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8b5d5-1424-428c-b0c1-a639a846b066 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:23.381113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8b5d5-1424-428c-b0c1-a639a846b066 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:23.382757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8b5d5-1424-428c-b0c1-a639a846b066 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:23.384925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 44/92] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:23 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:23.394912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8b5d5-1424-428c-b0c1-a639a846b066 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:23.396514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabdd88-483e-472b-b454-cf40ded5a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:23.397632 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabdd88-483e-472b-b454-cf40ded5a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:23.398093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabdd88-483e-472b-b454-cf40ded5a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:23.398537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabdd88-483e-472b-b454-cf40ded5a1a0 None admin] PATH_INFO: `/v3/users/12463e0931d04a7d9563aa3ed23c06af` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:23.400022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabdd88-483e-472b-b454-cf40ded5a1a0 None admin] RBAC: Authorizing `identity:get_user(user_id=12463e0931d04a7d9563aa3ed23c06af)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:23.401761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabdd88-483e-472b-b454-cf40ded5a1a0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:23.403793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 49/93] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:23 2022] GET /identity/v3/users/12463e0931d04a7d9563aa3ed23c06af => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:23.414947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabdd88-483e-472b-b454-cf40ded5a1a0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:23.556276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8b5d5-1424-428c-b0c1-a639a846b066 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:23.562288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabdd88-483e-472b-b454-cf40ded5a1a0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:23.600283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdecef2-4317-4400-8c70-fce0d765f13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:23.600880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdecef2-4317-4400-8c70-fce0d765f13f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:23.601172 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdecef2-4317-4400-8c70-fce0d765f13f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:23.601514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdecef2-4317-4400-8c70-fce0d765f13f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:23.603805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdecef2-4317-4400-8c70-fce0d765f13f None admin] RBAC: Adding query filter params (role.id=82e7000d778e4c66a98f07a93e8ae084, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c, user.id=12463e0931d04a7d9563aa3ed23c06af) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:23.604126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdecef2-4317-4400-8c70-fce0d765f13f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:23.606676 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdecef2-4317-4400-8c70-fce0d765f13f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:23.616018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 45/94] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:23 2022] GET /identity/v3/role_assignments?user.id=12463e0931d04a7d9563aa3ed23c06af&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=82e7000d778e4c66a98f07a93e8ae084 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:23.626357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a1424-5996-41c5-9596-1eb84abac295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:23.627416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a1424-5996-41c5-9596-1eb84abac295 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:23.627892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a1424-5996-41c5-9596-1eb84abac295 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:23.628360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a1424-5996-41c5-9596-1eb84abac295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:23.706589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a1424-5996-41c5-9596-1eb84abac295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:23.708098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a1424-5996-41c5-9596-1eb84abac295 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:23.812132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 50/95] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 12:40:23.819586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdecef2-4317-4400-8c70-fce0d765f13f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:23.954384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdecef2-4317-4400-8c70-fce0d765f13f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:23.990380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663eb75f-a500-4396-a1c1-bfa606146c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:23.991303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eb75f-a500-4396-a1c1-bfa606146c4b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:23.991598 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eb75f-a500-4396-a1c1-bfa606146c4b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:23.991880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663eb75f-a500-4396-a1c1-bfa606146c4b None admin] PATH_INFO: `/v3/projects/f650d7c323bd45f9b05f41ba843f3d7a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:23.993091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663eb75f-a500-4396-a1c1-bfa606146c4b None admin] RBAC: Authorizing `identity:get_project(project_id=f650d7c323bd45f9b05f41ba843f3d7a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:23.994641 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663eb75f-a500-4396-a1c1-bfa606146c4b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:23.996352 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 46/96] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:23 2022] GET /identity/v3/projects/f650d7c323bd45f9b05f41ba843f3d7a => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:24.003072 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a1424-5996-41c5-9596-1eb84abac295 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:24.127322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a1424-5996-41c5-9596-1eb84abac295 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:24.162227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec934dde-4bbb-40a9-9840-3ab47bee203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:24.162894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934dde-4bbb-40a9-9840-3ab47bee203a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:24.163180 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934dde-4bbb-40a9-9840-3ab47bee203a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:24.163461 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec934dde-4bbb-40a9-9840-3ab47bee203a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:24.164304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec934dde-4bbb-40a9-9840-3ab47bee203a None admin] RBAC: Adding query filter params (role.id=9b6d2d07e37f449699fd25de81ee509a, scope.project.id=f650d7c323bd45f9b05f41ba843f3d7a, user.id=12463e0931d04a7d9563aa3ed23c06af) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:24.164619 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec934dde-4bbb-40a9-9840-3ab47bee203a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:24.166103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec934dde-4bbb-40a9-9840-3ab47bee203a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:24.172765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 51/97] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:24 2022] GET /identity/v3/role_assignments?user.id=12463e0931d04a7d9563aa3ed23c06af&scope.project.id=f650d7c323bd45f9b05f41ba843f3d7a&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:26.010241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a9b22-a72d-4812-bd05-6f00670d5860 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:26.010814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a9b22-a72d-4812-bd05-6f00670d5860 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:26.010814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a9b22-a72d-4812-bd05-6f00670d5860 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:26.012708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 47/98] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:26.019675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb493be-f6a9-44d0-9d98-70748b567591 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:26.020572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb493be-f6a9-44d0-9d98-70748b567591 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:26.021055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb493be-f6a9-44d0-9d98-70748b567591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:26.044668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-feb493be-f6a9-44d0-9d98-70748b567591 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:26.046301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-feb493be-f6a9-44d0-9d98-70748b567591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:26.126036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:26.158095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a9b22-a72d-4812-bd05-6f00670d5860 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:26.310500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a9b22-a72d-4812-bd05-6f00670d5860 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:26.361927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321857e-27a6-4f11-a9b3-e4dbecca2cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:26.362751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321857e-27a6-4f11-a9b3-e4dbecca2cc4 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:26.363037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321857e-27a6-4f11-a9b3-e4dbecca2cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:26.363311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321857e-27a6-4f11-a9b3-e4dbecca2cc4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:26.383770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321857e-27a6-4f11-a9b3-e4dbecca2cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:26.391935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-4321857e-27a6-4f11-a9b3-e4dbecca2cc4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:26.393237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 48/100] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:26.399292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb493be-f6a9-44d0-9d98-70748b567591 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:26.523727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb493be-f6a9-44d0-9d98-70748b567591 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:26.565740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7fffb-6b07-4944-a00b-29617523fb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:26.566790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7fffb-6b07-4944-a00b-29617523fb95 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:26.567283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7fffb-6b07-4944-a00b-29617523fb95 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:26.567766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7fffb-6b07-4944-a00b-29617523fb95 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:26.568721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7fffb-6b07-4944-a00b-29617523fb95 None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:26.569234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7fffb-6b07-4944-a00b-29617523fb95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:26.570857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7fffb-6b07-4944-a00b-29617523fb95 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:26.582293 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 53/101] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:26.590639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321857e-27a6-4f11-a9b3-e4dbecca2cc4 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:26.735822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321857e-27a6-4f11-a9b3-e4dbecca2cc4 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:26.789184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca54a8-a776-4a8f-8f42-56c4317a7205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:26.790115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca54a8-a776-4a8f-8f42-56c4317a7205 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:26.790398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca54a8-a776-4a8f-8f42-56c4317a7205 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:26.790673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca54a8-a776-4a8f-8f42-56c4317a7205 None admin] PATH_INFO: `/v3/users/12463e0931d04a7d9563aa3ed23c06af` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:26.791888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca54a8-a776-4a8f-8f42-56c4317a7205 None admin] RBAC: Authorizing `identity:get_user(user_id=12463e0931d04a7d9563aa3ed23c06af)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:26.793377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca54a8-a776-4a8f-8f42-56c4317a7205 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:26.795216 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 49/102] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:26 2022] GET /identity/v3/users/12463e0931d04a7d9563aa3ed23c06af => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:26.801919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7fffb-6b07-4944-a00b-29617523fb95 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:26.971753 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7fffb-6b07-4944-a00b-29617523fb95 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:26.972288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c289-7fdf-47ab-9ac9-05d4adeab98f None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:26.972829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c289-7fdf-47ab-9ac9-05d4adeab98f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:26.973321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261c289-7fdf-47ab-9ac9-05d4adeab98f None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:26.976277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 50/103] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:26.980271 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda59d6-2cec-433c-983d-674fca733f0d None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:26.980805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda59d6-2cec-433c-983d-674fca733f0d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:26.981293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda59d6-2cec-433c-983d-674fca733f0d None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:26.982792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 51/104] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:26.985245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67083f9-630a-4d4f-8827-bb5047a40e70 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:26.985786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67083f9-630a-4d4f-8827-bb5047a40e70 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:26.986283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67083f9-630a-4d4f-8827-bb5047a40e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.007507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53a640-ced9-483d-b1aa-11616b34d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:27.008375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a640-ced9-483d-b1aa-11616b34d360 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.008665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a640-ced9-483d-b1aa-11616b34d360 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.008947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53a640-ced9-483d-b1aa-11616b34d360 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.010180 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53a640-ced9-483d-b1aa-11616b34d360 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:27.011659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53a640-ced9-483d-b1aa-11616b34d360 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:27.013358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 54/105] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:26 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:27.019403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e67083f9-630a-4d4f-8827-bb5047a40e70 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:27.020630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e67083f9-630a-4d4f-8827-bb5047a40e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:27.023644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba299d97-5977-45f1-97b3-f471915a8c37 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.024087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba299d97-5977-45f1-97b3-f471915a8c37 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.024179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba299d97-5977-45f1-97b3-f471915a8c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.057781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-ba299d97-5977-45f1-97b3-f471915a8c37 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:27.059009 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-ba299d97-5977-45f1-97b3-f471915a8c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:27.155628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 52/106] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:27.158996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67083f9-630a-4d4f-8827-bb5047a40e70 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:27.186057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 55/107] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:27.187694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb59a67-5443-4fe9-9332-3962850b006e None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.188274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb59a67-5443-4fe9-9332-3962850b006e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.188740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb59a67-5443-4fe9-9332-3962850b006e None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.190193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 56/108] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:27.191029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb59a67-5443-4fe9-9332-3962850b006e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:27.275754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67083f9-630a-4d4f-8827-bb5047a40e70 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:27.306996 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb59a67-5443-4fe9-9332-3962850b006e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:27.310164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2ca16-49c2-41e2-a2dd-c8d46de532a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:27.311048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ca16-49c2-41e2-a2dd-c8d46de532a8 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.311327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ca16-49c2-41e2-a2dd-c8d46de532a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.311599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ca16-49c2-41e2-a2dd-c8d46de532a8 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/users/12463e0931d04a7d9563aa3ed23c06af/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.313847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2ca16-49c2-41e2-a2dd-c8d46de532a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=42b621529bfd4baeb56fe9e133ee6b7c, user_id=12463e0931d04a7d9563aa3ed23c06af, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:27.315477 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2ca16-49c2-41e2-a2dd-c8d46de532a8 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:27.337027 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 53/109] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:40:27 2022] PUT /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/users/12463e0931d04a7d9563aa3ed23c06af/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:27.338284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274255a4-e875-40f9-aca3-d5db556ef68a None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.338580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274255a4-e875-40f9-aca3-d5db556ef68a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.338857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274255a4-e875-40f9-aca3-d5db556ef68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.346706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb6749-08b1-4cb0-bea4-d8fc65a797c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:27.347524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb6749-08b1-4cb0-bea4-d8fc65a797c3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.347815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb6749-08b1-4cb0-bea4-d8fc65a797c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.348100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb6749-08b1-4cb0-bea4-d8fc65a797c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.365098 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-274255a4-e875-40f9-aca3-d5db556ef68a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:27.365324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb6749-08b1-4cb0-bea4-d8fc65a797c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:27.367170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-274255a4-e875-40f9-aca3-d5db556ef68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:27.372459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-6fcb6749-08b1-4cb0-bea4-d8fc65a797c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:40:27.373852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 57/110] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:40:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:27.374834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb6749-08b1-4cb0-bea4-d8fc65a797c3 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:27.446381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 54/111] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:27.448195 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0abd83-6dde-4627-b9da-3b15234d5c5d None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.448711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0abd83-6dde-4627-b9da-3b15234d5c5d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.449182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0abd83-6dde-4627-b9da-3b15234d5c5d None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.450795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 55/112] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:27.456335 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0abd83-6dde-4627-b9da-3b15234d5c5d None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:27.486741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb6749-08b1-4cb0-bea4-d8fc65a797c3 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:27.530040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e66295-6a74-40bb-801f-d6595fbe5732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:27.530781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e66295-6a74-40bb-801f-d6595fbe5732 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.531710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e66295-6a74-40bb-801f-d6595fbe5732 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.531991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e66295-6a74-40bb-801f-d6595fbe5732 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.533375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e66295-6a74-40bb-801f-d6595fbe5732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:27.534885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e66295-6a74-40bb-801f-d6595fbe5732 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:27.536934 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 58/113] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:27.542492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc986b8-6abc-4a5e-8eb4-a44d01bf0e91 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.542796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc986b8-6abc-4a5e-8eb4-a44d01bf0e91 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.543084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc986b8-6abc-4a5e-8eb4-a44d01bf0e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.561500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-0bc986b8-6abc-4a5e-8eb4-a44d01bf0e91 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:27.562776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0bc986b8-6abc-4a5e-8eb4-a44d01bf0e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:27.587711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0abd83-6dde-4627-b9da-3b15234d5c5d None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:27.626354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34403e3-ced2-4a3e-a58c-e7e70b1e7ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:27.627271 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34403e3-ced2-4a3e-a58c-e7e70b1e7ba4 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.627647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34403e3-ced2-4a3e-a58c-e7e70b1e7ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.628049 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34403e3-ced2-4a3e-a58c-e7e70b1e7ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.628900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34403e3-ced2-4a3e-a58c-e7e70b1e7ba4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:27.629307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34403e3-ced2-4a3e-a58c-e7e70b1e7ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:27.630948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34403e3-ced2-4a3e-a58c-e7e70b1e7ba4 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:27.639704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 56/114] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:27.640984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34403e3-ced2-4a3e-a58c-e7e70b1e7ba4 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:27.649317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 59/115] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:27.650670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc986b8-6abc-4a5e-8eb4-a44d01bf0e91 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:27.756750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34403e3-ced2-4a3e-a58c-e7e70b1e7ba4 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:27.761390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc986b8-6abc-4a5e-8eb4-a44d01bf0e91 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:27.801542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805339b-6577-4527-97c2-4956741c3790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:27.802971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805339b-6577-4527-97c2-4956741c3790 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.803264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805339b-6577-4527-97c2-4956741c3790 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.803548 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805339b-6577-4527-97c2-4956741c3790 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.811352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14439d-e721-4a31-8766-ebdc62194925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:27.813098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14439d-e721-4a31-8766-ebdc62194925 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:27.813724 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14439d-e721-4a31-8766-ebdc62194925 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:27.814269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14439d-e721-4a31-8766-ebdc62194925 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:27.815877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14439d-e721-4a31-8766-ebdc62194925 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:27.815993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805339b-6577-4527-97c2-4956741c3790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:27.818036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14439d-e721-4a31-8766-ebdc62194925 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:27.824317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-7805339b-6577-4527-97c2-4956741c3790 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:40:27.825877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 57/116] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:40:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:27.826695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805339b-6577-4527-97c2-4956741c3790 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:27.859695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 60/117] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:40:27 2022] POST /identity/v3/projects => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:27.866433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14439d-e721-4a31-8766-ebdc62194925 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:27.991553 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805339b-6577-4527-97c2-4956741c3790 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.006533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14439d-e721-4a31-8766-ebdc62194925 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.034617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ff786-c5f4-40a2-a21f-7a8a453f8394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.035511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff786-c5f4-40a2-a21f-7a8a453f8394 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.035796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff786-c5f4-40a2-a21f-7a8a453f8394 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.036073 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff786-c5f4-40a2-a21f-7a8a453f8394 None admin] PATH_INFO: `/v3/users/3e20a973b647478db16f26c4e132ad3b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.037332 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ff786-c5f4-40a2-a21f-7a8a453f8394 None admin] RBAC: Authorizing `identity:get_user(user_id=3e20a973b647478db16f26c4e132ad3b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:28.038889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ff786-c5f4-40a2-a21f-7a8a453f8394 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:28.040578 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 58/118] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:27 2022] GET /identity/v3/users/3e20a973b647478db16f26c4e132ad3b => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:28.044381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32e2c-68bb-4fe1-8893-0146798ed8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.045245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32e2c-68bb-4fe1-8893-0146798ed8a7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.045532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32e2c-68bb-4fe1-8893-0146798ed8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.045853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32e2c-68bb-4fe1-8893-0146798ed8a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.046043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ff786-c5f4-40a2-a21f-7a8a453f8394 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:28.058758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32e2c-68bb-4fe1-8893-0146798ed8a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:28.066216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-0cc32e2c-68bb-4fe1-8893-0146798ed8a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 12:40:28.067457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 61/119] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:28.068673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999b29-ad2a-402a-9605-2780743169dd None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.068964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999b29-ad2a-402a-9605-2780743169dd None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.069244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87999b29-ad2a-402a-9605-2780743169dd None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.074677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 62/120] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:28.074677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87999b29-ad2a-402a-9605-2780743169dd None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:28.163133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ff786-c5f4-40a2-a21f-7a8a453f8394 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.200660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9937553-c8a7-4f15-abfd-3055e7569061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.201709 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9937553-c8a7-4f15-abfd-3055e7569061 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.202214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9937553-c8a7-4f15-abfd-3055e7569061 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.202702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9937553-c8a7-4f15-abfd-3055e7569061 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.203821 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9937553-c8a7-4f15-abfd-3055e7569061 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:28.204407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9937553-c8a7-4f15-abfd-3055e7569061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:28.206354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9937553-c8a7-4f15-abfd-3055e7569061 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:28.216019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 59/121] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:40:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:28.218686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9937553-c8a7-4f15-abfd-3055e7569061 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:28.232540 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87999b29-ad2a-402a-9605-2780743169dd None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.275731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352c70-84e7-47ba-b84f-7c434ef62797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.277238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352c70-84e7-47ba-b84f-7c434ef62797 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.277659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352c70-84e7-47ba-b84f-7c434ef62797 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.277844 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352c70-84e7-47ba-b84f-7c434ef62797 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.279026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39352c70-84e7-47ba-b84f-7c434ef62797 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:28.280500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39352c70-84e7-47ba-b84f-7c434ef62797 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:28.282568 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 63/122] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:28 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:28.283768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea107f1-42dd-4fb6-bb33-2a8f5bce462c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.284052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea107f1-42dd-4fb6-bb33-2a8f5bce462c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.284327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea107f1-42dd-4fb6-bb33-2a8f5bce462c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.303481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-6ea107f1-42dd-4fb6-bb33-2a8f5bce462c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:28.304672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6ea107f1-42dd-4fb6-bb33-2a8f5bce462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:28.337615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9937553-c8a7-4f15-abfd-3055e7569061 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.370006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc7a84-494b-4ecb-800b-9bf094eb741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.370793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc7a84-494b-4ecb-800b-9bf094eb741d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.371331 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc7a84-494b-4ecb-800b-9bf094eb741d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.371823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc7a84-494b-4ecb-800b-9bf094eb741d None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.372044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 64/123] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:28.372894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea107f1-42dd-4fb6-bb33-2a8f5bce462c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:28.378449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc7a84-494b-4ecb-800b-9bf094eb741d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:28.378829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc7a84-494b-4ecb-800b-9bf094eb741d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:28.380335 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc7a84-494b-4ecb-800b-9bf094eb741d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:28.396406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 60/124] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:28.397449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc7a84-494b-4ecb-800b-9bf094eb741d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:28.475957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea107f1-42dd-4fb6-bb33-2a8f5bce462c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.519033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc7a84-494b-4ecb-800b-9bf094eb741d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.519376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b352a4-46c4-485d-baec-f6608dcd7544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.520289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b352a4-46c4-485d-baec-f6608dcd7544 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.520571 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b352a4-46c4-485d-baec-f6608dcd7544 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.520856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b352a4-46c4-485d-baec-f6608dcd7544 None admin] PATH_INFO: `/v3/users/12463e0931d04a7d9563aa3ed23c06af` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.522231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b352a4-46c4-485d-baec-f6608dcd7544 None admin] RBAC: Authorizing `identity:get_user(user_id=12463e0931d04a7d9563aa3ed23c06af)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:28.523689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b352a4-46c4-485d-baec-f6608dcd7544 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:28.525306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 65/125] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:28 2022] GET /identity/v3/users/12463e0931d04a7d9563aa3ed23c06af => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:28.526091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b352a4-46c4-485d-baec-f6608dcd7544 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:28.554048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5b340-413b-43dd-b341-a3638b4d74ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.554939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5b340-413b-43dd-b341-a3638b4d74ce None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.555223 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5b340-413b-43dd-b341-a3638b4d74ce None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.555503 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5b340-413b-43dd-b341-a3638b4d74ce None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/users/3e20a973b647478db16f26c4e132ad3b/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.557488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5b340-413b-43dd-b341-a3638b4d74ce None admin] RBAC: Authorizing `identity:create_grant(project_id=42b621529bfd4baeb56fe9e133ee6b7c, user_id=3e20a973b647478db16f26c4e132ad3b, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:28.559011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5b340-413b-43dd-b341-a3638b4d74ce None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:28.577656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 61/126] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:40:28 2022] PUT /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/users/3e20a973b647478db16f26c4e132ad3b/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:28.579211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5b340-413b-43dd-b341-a3638b4d74ce None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:28.714322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b352a4-46c4-485d-baec-f6608dcd7544 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.725537 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5b340-413b-43dd-b341-a3638b4d74ce None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.751671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1d804-cae9-4fdf-a4c8-9e77bf1eae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.752557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d804-cae9-4fdf-a4c8-9e77bf1eae96 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.752845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d804-cae9-4fdf-a4c8-9e77bf1eae96 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.753121 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1d804-cae9-4fdf-a4c8-9e77bf1eae96 None admin] PATH_INFO: `/v3/users/cef630d1e40a409dbe99ffa61bc34c75` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.762785 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6628b6c-722b-48ed-936b-e6ec9bc2bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.763977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628b6c-722b-48ed-936b-e6ec9bc2bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.764456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628b6c-722b-48ed-936b-e6ec9bc2bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.764941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628b6c-722b-48ed-936b-e6ec9bc2bfa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.767880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1d804-cae9-4fdf-a4c8-9e77bf1eae96 None admin] RBAC: Authorizing `identity:get_user(user_id=cef630d1e40a409dbe99ffa61bc34c75)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:28.769376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1d804-cae9-4fdf-a4c8-9e77bf1eae96 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:28.771188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 66/127] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:28 2022] GET /identity/v3/users/cef630d1e40a409dbe99ffa61bc34c75 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:28.771990 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1d804-cae9-4fdf-a4c8-9e77bf1eae96 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:28.778763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6628b6c-722b-48ed-936b-e6ec9bc2bfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:28.787239 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-a6628b6c-722b-48ed-936b-e6ec9bc2bfa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:28.789176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 62/128] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:28.790339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6628b6c-722b-48ed-936b-e6ec9bc2bfa9 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:28.878459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1d804-cae9-4fdf-a4c8-9e77bf1eae96 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.912064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6628b6c-722b-48ed-936b-e6ec9bc2bfa9 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:28.916425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d9b5f-1469-4e2a-a4d1-67f6bf4fdb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.917540 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9b5f-1469-4e2a-a4d1-67f6bf4fdb95 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.918084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9b5f-1469-4e2a-a4d1-67f6bf4fdb95 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.918564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d9b5f-1469-4e2a-a4d1-67f6bf4fdb95 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:28.919980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d9b5f-1469-4e2a-a4d1-67f6bf4fdb95 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:28.921765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d9b5f-1469-4e2a-a4d1-67f6bf4fdb95 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:28.923682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 67/129] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:28 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:28.924646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d9b5f-1469-4e2a-a4d1-67f6bf4fdb95 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:28.953242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121435b-df7b-4c3b-a00b-64f924263f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:28.955041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121435b-df7b-4c3b-a00b-64f924263f3c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:28.956184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121435b-df7b-4c3b-a00b-64f924263f3c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:28.956827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121435b-df7b-4c3b-a00b-64f924263f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:29.081248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d9b5f-1469-4e2a-a4d1-67f6bf4fdb95 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:29.084418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121435b-df7b-4c3b-a00b-64f924263f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:29.086440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121435b-df7b-4c3b-a00b-64f924263f3c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:29.147171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397316cd-f733-4f68-ad9b-4ab26304884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:29.148221 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397316cd-f733-4f68-ad9b-4ab26304884d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:29.150497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397316cd-f733-4f68-ad9b-4ab26304884d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:29.150974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397316cd-f733-4f68-ad9b-4ab26304884d None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:29.151933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397316cd-f733-4f68-ad9b-4ab26304884d None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:29.154036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397316cd-f733-4f68-ad9b-4ab26304884d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:29.158864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397316cd-f733-4f68-ad9b-4ab26304884d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:29.175630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 68/130] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:29.178360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397316cd-f733-4f68-ad9b-4ab26304884d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:29.252597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 63/131] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:29.253936 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121435b-df7b-4c3b-a00b-64f924263f3c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:29.354446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121435b-df7b-4c3b-a00b-64f924263f3c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:29.369722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397316cd-f733-4f68-ad9b-4ab26304884d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:29.389262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f64d0-255c-4251-a271-d867b3e11eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:29.391119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f64d0-255c-4251-a271-d867b3e11eef None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:29.391619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f64d0-255c-4251-a271-d867b3e11eef None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:29.392087 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f64d0-255c-4251-a271-d867b3e11eef None admin] PATH_INFO: `/v3/users/12463e0931d04a7d9563aa3ed23c06af` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:29.393543 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f64d0-255c-4251-a271-d867b3e11eef None admin] RBAC: Authorizing `identity:get_user(user_id=12463e0931d04a7d9563aa3ed23c06af)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:29.395312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f64d0-255c-4251-a271-d867b3e11eef None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:29.397183 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 64/132] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:29 2022] GET /identity/v3/users/12463e0931d04a7d9563aa3ed23c06af => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:29.398231 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f64d0-255c-4251-a271-d867b3e11eef None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:29.427835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf824a-7f25-443b-ac62-2d6082667651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:29.428773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf824a-7f25-443b-ac62-2d6082667651 None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:29.429014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf824a-7f25-443b-ac62-2d6082667651 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:29.429289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf824a-7f25-443b-ac62-2d6082667651 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/users/12463e0931d04a7d9563aa3ed23c06af/roles/82e7000d778e4c66a98f07a93e8ae084` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:29.435917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf824a-7f25-443b-ac62-2d6082667651 None admin] RBAC: Authorizing `identity:create_grant(project_id=42b621529bfd4baeb56fe9e133ee6b7c, user_id=12463e0931d04a7d9563aa3ed23c06af, role_id=82e7000d778e4c66a98f07a93e8ae084)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:29.438032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf824a-7f25-443b-ac62-2d6082667651 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:29.471994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 69/133] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:40:29 2022] PUT /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/users/12463e0931d04a7d9563aa3ed23c06af/roles/82e7000d778e4c66a98f07a93e8ae084 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:29.472626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf824a-7f25-443b-ac62-2d6082667651 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:29.509061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f64d0-255c-4251-a271-d867b3e11eef None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:29.546534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da03d5-d55b-43cc-98a6-1e59c39fd6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:29.547838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da03d5-d55b-43cc-98a6-1e59c39fd6c6 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:29.548396 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da03d5-d55b-43cc-98a6-1e59c39fd6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:29.548877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da03d5-d55b-43cc-98a6-1e59c39fd6c6 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:29.550305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da03d5-d55b-43cc-98a6-1e59c39fd6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:29.552408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da03d5-d55b-43cc-98a6-1e59c39fd6c6 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:29.554556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 65/134] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:29 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:29.566694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da03d5-d55b-43cc-98a6-1e59c39fd6c6 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:29.588003 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf824a-7f25-443b-ac62-2d6082667651 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:29.629969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0072966-fed6-4c87-9ce7-11e171395cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:29.631074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0072966-fed6-4c87-9ce7-11e171395cc6 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:29.631198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0072966-fed6-4c87-9ce7-11e171395cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:29.631411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0072966-fed6-4c87-9ce7-11e171395cc6 None admin] PATH_INFO: `/v3/projects/f650d7c323bd45f9b05f41ba843f3d7a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:29.638397 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0072966-fed6-4c87-9ce7-11e171395cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=f650d7c323bd45f9b05f41ba843f3d7a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:29.640018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0072966-fed6-4c87-9ce7-11e171395cc6 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:29.642729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 70/135] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:29 2022] GET /identity/v3/projects/f650d7c323bd45f9b05f41ba843f3d7a => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:29.648646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0072966-fed6-4c87-9ce7-11e171395cc6 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:29.700045 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da03d5-d55b-43cc-98a6-1e59c39fd6c6 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:29.743693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab4a1e-c40f-4d45-977a-40b37c7ae34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:29.744757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4a1e-c40f-4d45-977a-40b37c7ae34e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:29.745236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4a1e-c40f-4d45-977a-40b37c7ae34e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:29.745735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab4a1e-c40f-4d45-977a-40b37c7ae34e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:29.746793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab4a1e-c40f-4d45-977a-40b37c7ae34e None admin] RBAC: Adding query filter params (role.id=3f30dd1042dd434e99b85ce46f6e84cb, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c, user.id=cef630d1e40a409dbe99ffa61bc34c75) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:29.747318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab4a1e-c40f-4d45-977a-40b37c7ae34e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:29.748988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab4a1e-c40f-4d45-977a-40b37c7ae34e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:29.761079 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 66/136] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:29 2022] GET /identity/v3/role_assignments?user.id=cef630d1e40a409dbe99ffa61bc34c75&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=3f30dd1042dd434e99b85ce46f6e84cb => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:29.793993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0072966-fed6-4c87-9ce7-11e171395cc6 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:29.845421 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef1f30-578e-4f77-b18a-5b1b518d0d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:29.846283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef1f30-578e-4f77-b18a-5b1b518d0d7f None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:29.846571 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef1f30-578e-4f77-b18a-5b1b518d0d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:29.846851 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef1f30-578e-4f77-b18a-5b1b518d0d7f None admin] PATH_INFO: `/v3/projects/f650d7c323bd45f9b05f41ba843f3d7a/users/12463e0931d04a7d9563aa3ed23c06af/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:29.849060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef1f30-578e-4f77-b18a-5b1b518d0d7f None admin] RBAC: Authorizing `identity:create_grant(project_id=f650d7c323bd45f9b05f41ba843f3d7a, user_id=12463e0931d04a7d9563aa3ed23c06af, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:29.850629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef1f30-578e-4f77-b18a-5b1b518d0d7f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:29.874544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 71/137] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:40:29 2022] PUT /identity/v3/projects/f650d7c323bd45f9b05f41ba843f3d7a/users/12463e0931d04a7d9563aa3ed23c06af/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:30.229009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cba80d-461a-48d8-857d-579ca8556098 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:30.230020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cba80d-461a-48d8-857d-579ca8556098 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:30.230308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cba80d-461a-48d8-857d-579ca8556098 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:30.231846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 67/138] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:30.238225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d5c3-7ec6-47c9-a03f-b3353479eff6 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:30.238737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d5c3-7ec6-47c9-a03f-b3353479eff6 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:30.238808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d5c3-7ec6-47c9-a03f-b3353479eff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:30.259310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b052d5c3-7ec6-47c9-a03f-b3353479eff6 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:30.260503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b052d5c3-7ec6-47c9-a03f-b3353479eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:30.347897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 72/139] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:30.393664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cba80d-461a-48d8-857d-579ca8556098 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:30.531854 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cba80d-461a-48d8-857d-579ca8556098 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:30.574065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f895dc-2a8a-4135-8894-c72929c25191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:30.574869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f895dc-2a8a-4135-8894-c72929c25191 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:30.575151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f895dc-2a8a-4135-8894-c72929c25191 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:30.575425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f895dc-2a8a-4135-8894-c72929c25191 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:30.590484 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f895dc-2a8a-4135-8894-c72929c25191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:30.602118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-02f895dc-2a8a-4135-8894-c72929c25191 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:30.603517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 68/140] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:30.613354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052d5c3-7ec6-47c9-a03f-b3353479eff6 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:30.762216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052d5c3-7ec6-47c9-a03f-b3353479eff6 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:30.823310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbdb72-18c2-442c-8a46-cbcc3f804189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:30.823921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbdb72-18c2-442c-8a46-cbcc3f804189 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:30.824210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbdb72-18c2-442c-8a46-cbcc3f804189 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:30.824493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbdb72-18c2-442c-8a46-cbcc3f804189 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:30.825265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbdb72-18c2-442c-8a46-cbcc3f804189 None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:30.825601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbdb72-18c2-442c-8a46-cbcc3f804189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:30.827013 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbdb72-18c2-442c-8a46-cbcc3f804189 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:30.841195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 73/141] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:30.846851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f895dc-2a8a-4135-8894-c72929c25191 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:30.884725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8718d-9371-41a6-8019-a5710fa38de7 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:30.885337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8718d-9371-41a6-8019-a5710fa38de7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:30.885664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8718d-9371-41a6-8019-a5710fa38de7 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:30.887052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 74/142] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:30.893603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f07b-b6ca-4e41-aa68-a2709d637924 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:30.893916 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f07b-b6ca-4e41-aa68-a2709d637924 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:30.894200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461f07b-b6ca-4e41-aa68-a2709d637924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:30.914782 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-4461f07b-b6ca-4e41-aa68-a2709d637924 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:30.916404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4461f07b-b6ca-4e41-aa68-a2709d637924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:31.001843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 75/143] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:31.024562 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461f07b-b6ca-4e41-aa68-a2709d637924 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:31.040414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f895dc-2a8a-4135-8894-c72929c25191 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:31.105893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89ff33-5147-4f5a-9503-e1cf36888311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:31.106698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ff33-5147-4f5a-9503-e1cf36888311 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:31.106986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ff33-5147-4f5a-9503-e1cf36888311 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:31.107266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89ff33-5147-4f5a-9503-e1cf36888311 None admin] PATH_INFO: `/v3/users/12463e0931d04a7d9563aa3ed23c06af` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:31.108602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89ff33-5147-4f5a-9503-e1cf36888311 None admin] RBAC: Authorizing `identity:get_user(user_id=12463e0931d04a7d9563aa3ed23c06af)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:31.110800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89ff33-5147-4f5a-9503-e1cf36888311 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:31.114638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 69/144] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:30 2022] GET /identity/v3/users/12463e0931d04a7d9563aa3ed23c06af => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:31.119364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89ff33-5147-4f5a-9503-e1cf36888311 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:31.221408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461f07b-b6ca-4e41-aa68-a2709d637924 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:31.230640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89ff33-5147-4f5a-9503-e1cf36888311 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:31.268905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae91bb-357f-4e78-8541-165dcadffef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:31.269621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae91bb-357f-4e78-8541-165dcadffef3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:31.269904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae91bb-357f-4e78-8541-165dcadffef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:31.270188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae91bb-357f-4e78-8541-165dcadffef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:31.306852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ef6ce-d919-4f31-a105-0b16941187c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:31.307660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef6ce-d919-4f31-a105-0b16941187c3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:31.307947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef6ce-d919-4f31-a105-0b16941187c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:31.308226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ef6ce-d919-4f31-a105-0b16941187c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:31.314331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ef6ce-d919-4f31-a105-0b16941187c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:31.315854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ef6ce-d919-4f31-a105-0b16941187c3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:31.317751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 76/145] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:31.338584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ef6ce-d919-4f31-a105-0b16941187c3 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:31.352526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae91bb-357f-4e78-8541-165dcadffef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:31.354161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae91bb-357f-4e78-8541-165dcadffef3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:31.458821 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 70/146] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:31.464568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae91bb-357f-4e78-8541-165dcadffef3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:31.550557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ef6ce-d919-4f31-a105-0b16941187c3 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:31.568992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae91bb-357f-4e78-8541-165dcadffef3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:31.606904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb8605-294a-408c-83c9-f73b8723673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:31.607918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb8605-294a-408c-83c9-f73b8723673d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:31.608211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb8605-294a-408c-83c9-f73b8723673d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:31.608491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb8605-294a-408c-83c9-f73b8723673d None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:31.610515 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb8605-294a-408c-83c9-f73b8723673d None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:31.612196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb8605-294a-408c-83c9-f73b8723673d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:31.618054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 71/147] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:31 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:31.620580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb8605-294a-408c-83c9-f73b8723673d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:31.646363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705403b-0513-4750-a664-d66347d0de4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:31.647117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705403b-0513-4750-a664-d66347d0de4c None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:31.647351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705403b-0513-4750-a664-d66347d0de4c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:31.647633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705403b-0513-4750-a664-d66347d0de4c None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:31.648365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705403b-0513-4750-a664-d66347d0de4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:31.649864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705403b-0513-4750-a664-d66347d0de4c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:31.698478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 77/148] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:40:31 2022] POST /identity/v3/users => generated 283 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:40:31.739910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb8605-294a-408c-83c9-f73b8723673d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:31.787112 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e081-82d5-408b-8f90-35cdf557c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:31.787805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e081-82d5-408b-8f90-35cdf557c3ce None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:31.788097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e081-82d5-408b-8f90-35cdf557c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:31.788382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e081-82d5-408b-8f90-35cdf557c3ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:31.789303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e081-82d5-408b-8f90-35cdf557c3ce None admin] RBAC: Adding query filter params (role.id=9b6d2d07e37f449699fd25de81ee509a, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c, user.id=12463e0931d04a7d9563aa3ed23c06af) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:31.789654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e081-82d5-408b-8f90-35cdf557c3ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:31.791196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e081-82d5-408b-8f90-35cdf557c3ce None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:31.805765 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 72/149] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:31 2022] GET /identity/v3/role_assignments?user.id=12463e0931d04a7d9563aa3ed23c06af&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:32.182481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba02b9-00f8-404d-a15f-bc73abf44b64 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:32.182847 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba02b9-00f8-404d-a15f-bc73abf44b64 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:32.183038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba02b9-00f8-404d-a15f-bc73abf44b64 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:32.184601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 78/150] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:32.192162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4322cd-3112-4b82-a4d4-5b0a4144b69b None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:32.192454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4322cd-3112-4b82-a4d4-5b0a4144b69b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:32.192741 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4322cd-3112-4b82-a4d4-5b0a4144b69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:32.214166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-aa4322cd-3112-4b82-a4d4-5b0a4144b69b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:32.215672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-aa4322cd-3112-4b82-a4d4-5b0a4144b69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:32.285792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 73/151] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:32.311489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba02b9-00f8-404d-a15f-bc73abf44b64 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:32.427447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba02b9-00f8-404d-a15f-bc73abf44b64 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:32.469299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ee11a-fc73-4546-8507-c1ce54353366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:32.470529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ee11a-fc73-4546-8507-c1ce54353366 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:32.471043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ee11a-fc73-4546-8507-c1ce54353366 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:32.471529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ee11a-fc73-4546-8507-c1ce54353366 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:32.486807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ee11a-fc73-4546-8507-c1ce54353366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:32.494539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-db0ee11a-fc73-4546-8507-c1ce54353366 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:40:32.496173 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 79/152] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:40:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:32.503979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4322cd-3112-4b82-a4d4-5b0a4144b69b None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:32.621965 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4322cd-3112-4b82-a4d4-5b0a4144b69b None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:32.660781 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0295110-3727-4a15-9d2f-6be6c1dff4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:32.661851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0295110-3727-4a15-9d2f-6be6c1dff4a3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:32.662358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0295110-3727-4a15-9d2f-6be6c1dff4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:32.662909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0295110-3727-4a15-9d2f-6be6c1dff4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:32.663864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0295110-3727-4a15-9d2f-6be6c1dff4a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:32.664439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0295110-3727-4a15-9d2f-6be6c1dff4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:32.666080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0295110-3727-4a15-9d2f-6be6c1dff4a3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:32.675974 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 74/153] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:32.681806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ee11a-fc73-4546-8507-c1ce54353366 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:32.790339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ee11a-fc73-4546-8507-c1ce54353366 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:32.829539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff7b31-775e-4afb-bfa6-3badf84e7f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:32.830462 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7b31-775e-4afb-bfa6-3badf84e7f23 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:32.830751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7b31-775e-4afb-bfa6-3badf84e7f23 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:32.831034 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff7b31-775e-4afb-bfa6-3badf84e7f23 None admin] PATH_INFO: `/v3/users/3e20a973b647478db16f26c4e132ad3b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:32.832255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff7b31-775e-4afb-bfa6-3badf84e7f23 None admin] RBAC: Authorizing `identity:get_user(user_id=3e20a973b647478db16f26c4e132ad3b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:32.833767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff7b31-775e-4afb-bfa6-3badf84e7f23 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:32.835568 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 80/154] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:32 2022] GET /identity/v3/users/3e20a973b647478db16f26c4e132ad3b => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:32.841046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0295110-3727-4a15-9d2f-6be6c1dff4a3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:32.931128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f795b5f-1b2d-454b-b9fa-d8d42a41cd71 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:32.931437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f795b5f-1b2d-454b-b9fa-d8d42a41cd71 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:32.931688 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f795b5f-1b2d-454b-b9fa-d8d42a41cd71 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:32.937089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 81/155] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:32.939594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdc0db-3371-48ca-9bd8-da09c8e7ae38 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:32.940090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdc0db-3371-48ca-9bd8-da09c8e7ae38 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:32.940586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdc0db-3371-48ca-9bd8-da09c8e7ae38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:32.956672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0295110-3727-4a15-9d2f-6be6c1dff4a3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:32.960522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-c6bdc0db-3371-48ca-9bd8-da09c8e7ae38 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:32.962028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c6bdc0db-3371-48ca-9bd8-da09c8e7ae38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:33.021317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f04bb-40fb-4f99-87ea-c5be2513686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:33.022983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f04bb-40fb-4f99-87ea-c5be2513686f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.024691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f04bb-40fb-4f99-87ea-c5be2513686f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.025189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f04bb-40fb-4f99-87ea-c5be2513686f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.097656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 82/156] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:33.099494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165721b2-7403-4160-9c5a-1a64a9b02f14 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.099986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165721b2-7403-4160-9c5a-1a64a9b02f14 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.100458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165721b2-7403-4160-9c5a-1a64a9b02f14 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.102098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 83/157] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:33.110603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616a0e-1895-453d-af08-9f35035069d9 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.111202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616a0e-1895-453d-af08-9f35035069d9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.111715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c616a0e-1895-453d-af08-9f35035069d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.125124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f04bb-40fb-4f99-87ea-c5be2513686f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:33.126902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f04bb-40fb-4f99-87ea-c5be2513686f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:33.138958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-7c616a0e-1895-453d-af08-9f35035069d9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:33.140509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7c616a0e-1895-453d-af08-9f35035069d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:33.214897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 84/158] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:33.215955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c616a0e-1895-453d-af08-9f35035069d9 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:33.235142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 75/159] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:33.252599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f04bb-40fb-4f99-87ea-c5be2513686f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:33.322981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c616a0e-1895-453d-af08-9f35035069d9 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:33.353872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f04bb-40fb-4f99-87ea-c5be2513686f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:33.363609 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6eef-acbb-435c-a99e-9fed3e5bdf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:33.364726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6eef-acbb-435c-a99e-9fed3e5bdf7a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.365267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6eef-acbb-435c-a99e-9fed3e5bdf7a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.365805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6eef-acbb-435c-a99e-9fed3e5bdf7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.377856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6eef-acbb-435c-a99e-9fed3e5bdf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:33.385610 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-050b6eef-acbb-435c-a99e-9fed3e5bdf7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:40:33.387142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 85/160] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:40:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:33.389764 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6eef-acbb-435c-a99e-9fed3e5bdf7a None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:33.401102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f681c-94d8-4be2-88dc-cf553493b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:33.401942 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f681c-94d8-4be2-88dc-cf553493b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.402222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f681c-94d8-4be2-88dc-cf553493b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.402487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f681c-94d8-4be2-88dc-cf553493b8a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.419050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f681c-94d8-4be2-88dc-cf553493b8a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:33.427375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-846f681c-94d8-4be2-88dc-cf553493b8a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:33.428807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 76/161] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:33.429395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f681c-94d8-4be2-88dc-cf553493b8a2 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:33.498300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6eef-acbb-435c-a99e-9fed3e5bdf7a None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:33.534089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e8000-f33c-4b2f-853b-aeeee622b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:33.535320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e8000-f33c-4b2f-853b-aeeee622b32b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.535805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e8000-f33c-4b2f-853b-aeeee622b32b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.536278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e8000-f33c-4b2f-853b-aeeee622b32b None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.537816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e8000-f33c-4b2f-853b-aeeee622b32b None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:33.539387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f681c-94d8-4be2-88dc-cf553493b8a2 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:33.539754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786e8000-f33c-4b2f-853b-aeeee622b32b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:33.541734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 86/162] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:33 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:33.543397 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fdb84-5dbe-48d1-a474-18870a89c66e None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.543889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fdb84-5dbe-48d1-a474-18870a89c66e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.544399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fdb84-5dbe-48d1-a474-18870a89c66e None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.545903 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 87/163] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:33.547098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fdb84-5dbe-48d1-a474-18870a89c66e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:33.579544 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623afe3f-84af-41e8-a504-17ca8bd785bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:33.580210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afe3f-84af-41e8-a504-17ca8bd785bb None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.580493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afe3f-84af-41e8-a504-17ca8bd785bb None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.580769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623afe3f-84af-41e8-a504-17ca8bd785bb None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.581597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afe3f-84af-41e8-a504-17ca8bd785bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:33.581851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afe3f-84af-41e8-a504-17ca8bd785bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:33.583548 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623afe3f-84af-41e8-a504-17ca8bd785bb None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:33.593859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 77/164] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:40:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:33.594049 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623afe3f-84af-41e8-a504-17ca8bd785bb None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:33.660602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fdb84-5dbe-48d1-a474-18870a89c66e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:33.695165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623afe3f-84af-41e8-a504-17ca8bd785bb None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:33.695486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aaa82e-ffbf-4e73-96ba-b9b9ed34a448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:33.696075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaa82e-ffbf-4e73-96ba-b9b9ed34a448 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.696359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaa82e-ffbf-4e73-96ba-b9b9ed34a448 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.696637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aaa82e-ffbf-4e73-96ba-b9b9ed34a448 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.697383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aaa82e-ffbf-4e73-96ba-b9b9ed34a448 None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:33.697730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aaa82e-ffbf-4e73-96ba-b9b9ed34a448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:33.699142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aaa82e-ffbf-4e73-96ba-b9b9ed34a448 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:33.708444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 88/165] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:33.709957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ffd8-f785-4cbc-833a-a38dc5148803 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.710249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ffd8-f785-4cbc-833a-a38dc5148803 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.710532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2ffd8-f785-4cbc-833a-a38dc5148803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.727550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-bac2ffd8-f785-4cbc-833a-a38dc5148803 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:33.728740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bac2ffd8-f785-4cbc-833a-a38dc5148803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:33.730129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc53c8a-99d8-4779-9d85-6110e85bf336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:33.730793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc53c8a-99d8-4779-9d85-6110e85bf336 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.731077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc53c8a-99d8-4779-9d85-6110e85bf336 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.731356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc53c8a-99d8-4779-9d85-6110e85bf336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.732197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc53c8a-99d8-4779-9d85-6110e85bf336 None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c, user.id=3e20a973b647478db16f26c4e132ad3b) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:33.732511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc53c8a-99d8-4779-9d85-6110e85bf336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:33.735501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc53c8a-99d8-4779-9d85-6110e85bf336 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:33.742057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 78/166] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:33 2022] GET /identity/v3/role_assignments?user.id=3e20a973b647478db16f26c4e132ad3b&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=c158bb1781c44a03890992161076b84b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:33.742950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc53c8a-99d8-4779-9d85-6110e85bf336 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:33.816587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 89/167] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:33.817480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2ffd8-f785-4cbc-833a-a38dc5148803 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:33.872596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc53c8a-99d8-4779-9d85-6110e85bf336 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:33.910597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c5302-462b-4496-bfc0-45baf39e9e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:33.911521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c5302-462b-4496-bfc0-45baf39e9e7e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:33.911751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c5302-462b-4496-bfc0-45baf39e9e7e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:33.912028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c5302-462b-4496-bfc0-45baf39e9e7e None admin] PATH_INFO: `/v3/users/12463e0931d04a7d9563aa3ed23c06af` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:33.913224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c5302-462b-4496-bfc0-45baf39e9e7e None admin] RBAC: Authorizing `identity:get_user(user_id=12463e0931d04a7d9563aa3ed23c06af)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:33.914736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c5302-462b-4496-bfc0-45baf39e9e7e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:33.916602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 79/168] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:33 2022] GET /identity/v3/users/12463e0931d04a7d9563aa3ed23c06af => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:33.917240 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c5302-462b-4496-bfc0-45baf39e9e7e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:33.977239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2ffd8-f785-4cbc-833a-a38dc5148803 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:34.020436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c5302-462b-4496-bfc0-45baf39e9e7e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:34.030065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeec727-442f-412a-8b1b-3c957f455cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:34.031769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeec727-442f-412a-8b1b-3c957f455cfa None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:34.032082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeec727-442f-412a-8b1b-3c957f455cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:34.032448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeec727-442f-412a-8b1b-3c957f455cfa None admin] PATH_INFO: `/v3/users/12463e0931d04a7d9563aa3ed23c06af` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:34.038333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeec727-442f-412a-8b1b-3c957f455cfa None admin] RBAC: Authorizing `identity:get_user(user_id=12463e0931d04a7d9563aa3ed23c06af)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:34.039840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeec727-442f-412a-8b1b-3c957f455cfa None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:34.041739 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 90/169] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:33 2022] GET /identity/v3/users/12463e0931d04a7d9563aa3ed23c06af => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:34.042425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeec727-442f-412a-8b1b-3c957f455cfa None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:34.058191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e113-f035-42a9-9d16-91e63c80a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:34.059050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e113-f035-42a9-9d16-91e63c80a555 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:34.059335 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e113-f035-42a9-9d16-91e63c80a555 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:34.059654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2e113-f035-42a9-9d16-91e63c80a555 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:34.071060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2e113-f035-42a9-9d16-91e63c80a555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:34.078923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-17b2e113-f035-42a9-9d16-91e63c80a555 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 12:40:34.080690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 80/170] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:34.081518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e113-f035-42a9-9d16-91e63c80a555 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:34.179899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeec727-442f-412a-8b1b-3c957f455cfa None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:34.209458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2e113-f035-42a9-9d16-91e63c80a555 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:34.230088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1712b-f8ef-405f-983a-a6ded6164d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:34.230875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1712b-f8ef-405f-983a-a6ded6164d72 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:34.231196 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1712b-f8ef-405f-983a-a6ded6164d72 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:34.231511 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1712b-f8ef-405f-983a-a6ded6164d72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:34.255896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325aaa-d140-4bca-8355-1d2d9bc6ea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:34.256648 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325aaa-d140-4bca-8355-1d2d9bc6ea7d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:34.256975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325aaa-d140-4bca-8355-1d2d9bc6ea7d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:34.257303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5325aaa-d140-4bca-8355-1d2d9bc6ea7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:34.315179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1712b-f8ef-405f-983a-a6ded6164d72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:34.316947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a1712b-f8ef-405f-983a-a6ded6164d72 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:34.351951 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325aaa-d140-4bca-8355-1d2d9bc6ea7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:34.353451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5325aaa-d140-4bca-8355-1d2d9bc6ea7d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:34.440590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 91/171] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:34.445934 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1712b-f8ef-405f-983a-a6ded6164d72 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:34.521250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 81/172] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:34.521965 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325aaa-d140-4bca-8355-1d2d9bc6ea7d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:34.557227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1712b-f8ef-405f-983a-a6ded6164d72 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:34.607072 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c9a16-6ac0-449f-bac1-bc975ffd39b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:34.608481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c9a16-6ac0-449f-bac1-bc975ffd39b3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:34.608847 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c9a16-6ac0-449f-bac1-bc975ffd39b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:34.609105 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c9a16-6ac0-449f-bac1-bc975ffd39b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:34.614910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c9a16-6ac0-449f-bac1-bc975ffd39b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:34.615239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c9a16-6ac0-449f-bac1-bc975ffd39b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:34.616648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c9a16-6ac0-449f-bac1-bc975ffd39b3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:34.631292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 92/173] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:34.632242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c9a16-6ac0-449f-bac1-bc975ffd39b3 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:34.746096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5325aaa-d140-4bca-8355-1d2d9bc6ea7d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:34.802809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c9a16-6ac0-449f-bac1-bc975ffd39b3 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:34.814284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a34bf4-ef75-42b7-b7d9-561be139317b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:34.815160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a34bf4-ef75-42b7-b7d9-561be139317b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:34.815442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a34bf4-ef75-42b7-b7d9-561be139317b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:34.815716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a34bf4-ef75-42b7-b7d9-561be139317b None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:34.816965 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a34bf4-ef75-42b7-b7d9-561be139317b None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:34.818485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a34bf4-ef75-42b7-b7d9-561be139317b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:34.820210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 82/174] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:34 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:34.822010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a34bf4-ef75-42b7-b7d9-561be139317b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:34.840032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c31c52-fb8e-4000-a60d-62abe26b070b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:34.841050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31c52-fb8e-4000-a60d-62abe26b070b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:34.841382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31c52-fb8e-4000-a60d-62abe26b070b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:34.841694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c31c52-fb8e-4000-a60d-62abe26b070b None admin] PATH_INFO: `/v3/projects/f650d7c323bd45f9b05f41ba843f3d7a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:34.842888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c31c52-fb8e-4000-a60d-62abe26b070b None admin] RBAC: Authorizing `identity:get_project(project_id=f650d7c323bd45f9b05f41ba843f3d7a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:34.844396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c31c52-fb8e-4000-a60d-62abe26b070b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:34.846553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 93/175] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:34 2022] GET /identity/v3/projects/f650d7c323bd45f9b05f41ba843f3d7a => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:34.847366 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c31c52-fb8e-4000-a60d-62abe26b070b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:34.958384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c31c52-fb8e-4000-a60d-62abe26b070b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:34.977057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a34bf4-ef75-42b7-b7d9-561be139317b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:34.997588 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe495c52-9ee5-4caf-87ed-a5e58d3db4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:34.998915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe495c52-9ee5-4caf-87ed-a5e58d3db4e0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:34.999203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe495c52-9ee5-4caf-87ed-a5e58d3db4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:35.000338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe495c52-9ee5-4caf-87ed-a5e58d3db4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:35.001308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe495c52-9ee5-4caf-87ed-a5e58d3db4e0 None admin] RBAC: Adding query filter params (role.id=82e7000d778e4c66a98f07a93e8ae084, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c, user.id=12463e0931d04a7d9563aa3ed23c06af) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:35.001830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe495c52-9ee5-4caf-87ed-a5e58d3db4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:35.003367 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe495c52-9ee5-4caf-87ed-a5e58d3db4e0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:35.009781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 94/176] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:34 2022] GET /identity/v3/role_assignments?user.id=12463e0931d04a7d9563aa3ed23c06af&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=82e7000d778e4c66a98f07a93e8ae084 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:35.010402 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe495c52-9ee5-4caf-87ed-a5e58d3db4e0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:35.078405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea416d-cc7f-49de-8756-aa63ecb96ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:35.079306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea416d-cc7f-49de-8756-aa63ecb96ab0 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:35.079585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea416d-cc7f-49de-8756-aa63ecb96ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:35.079855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea416d-cc7f-49de-8756-aa63ecb96ab0 None admin] PATH_INFO: `/v3/users/cef630d1e40a409dbe99ffa61bc34c75` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:35.081183 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea416d-cc7f-49de-8756-aa63ecb96ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=cef630d1e40a409dbe99ffa61bc34c75)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:35.082707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea416d-cc7f-49de-8756-aa63ecb96ab0 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:35.084412 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 83/177] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:34 2022] GET /identity/v3/users/cef630d1e40a409dbe99ffa61bc34c75 => generated 289 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:35.105788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea416d-cc7f-49de-8756-aa63ecb96ab0 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:35.129194 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe495c52-9ee5-4caf-87ed-a5e58d3db4e0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:35.164914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84307099-1aa8-4c1f-b569-726b10634361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:35.165600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307099-1aa8-4c1f-b569-726b10634361 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:35.165888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307099-1aa8-4c1f-b569-726b10634361 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:35.166163 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307099-1aa8-4c1f-b569-726b10634361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:35.167003 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84307099-1aa8-4c1f-b569-726b10634361 None admin] RBAC: Adding query filter params (role.id=9b6d2d07e37f449699fd25de81ee509a, scope.project.id=f650d7c323bd45f9b05f41ba843f3d7a, user.id=12463e0931d04a7d9563aa3ed23c06af) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:35.167372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84307099-1aa8-4c1f-b569-726b10634361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:35.168947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84307099-1aa8-4c1f-b569-726b10634361 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:35.176318 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 95/178] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:35 2022] GET /identity/v3/role_assignments?user.id=12463e0931d04a7d9563aa3ed23c06af&scope.project.id=f650d7c323bd45f9b05f41ba843f3d7a&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:35.280017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea416d-cc7f-49de-8756-aa63ecb96ab0 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:35.338351 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fb770-a151-40fd-bbc1-7e1898c6bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:35.339246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fb770-a151-40fd-bbc1-7e1898c6bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:35.339528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fb770-a151-40fd-bbc1-7e1898c6bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:35.339799 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fb770-a151-40fd-bbc1-7e1898c6bbe1 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:35.341074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fb770-a151-40fd-bbc1-7e1898c6bbe1 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:35.342576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fb770-a151-40fd-bbc1-7e1898c6bbe1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:35.345425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 84/179] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:35 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:35.351361 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84307099-1aa8-4c1f-b569-726b10634361 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:35.474557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84307099-1aa8-4c1f-b569-726b10634361 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:35.516853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a494e-1825-4bb0-b247-495a976ef97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:35.518148 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a494e-1825-4bb0-b247-495a976ef97a None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:35.518720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a494e-1825-4bb0-b247-495a976ef97a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:35.519276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a494e-1825-4bb0-b247-495a976ef97a None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/users/cef630d1e40a409dbe99ffa61bc34c75/roles/3f30dd1042dd434e99b85ce46f6e84cb` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:35.521800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a494e-1825-4bb0-b247-495a976ef97a None admin] RBAC: Authorizing `identity:create_grant(project_id=42b621529bfd4baeb56fe9e133ee6b7c, user_id=cef630d1e40a409dbe99ffa61bc34c75, role_id=3f30dd1042dd434e99b85ce46f6e84cb)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:35.523500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a494e-1825-4bb0-b247-495a976ef97a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:35.547188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 96/180] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:40:35 2022] PUT /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/users/cef630d1e40a409dbe99ffa61bc34c75/roles/3f30dd1042dd434e99b85ce46f6e84cb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:36.098256 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d938d5-4127-438a-9869-a0eabed6d7a0 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.098768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d938d5-4127-438a-9869-a0eabed6d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.098843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d938d5-4127-438a-9869-a0eabed6d7a0 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.100338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 85/181] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:36.105548 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47824b1-595e-4608-a6c1-1f0bbfca0be6 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.105874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47824b1-595e-4608-a6c1-1f0bbfca0be6 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.106153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47824b1-595e-4608-a6c1-1f0bbfca0be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.123243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e47824b1-595e-4608-a6c1-1f0bbfca0be6 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:36.124998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e47824b1-595e-4608-a6c1-1f0bbfca0be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:36.188627 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e116c6-679a-4667-b79a-4cdbe336fa0d None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.189234 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e116c6-679a-4667-b79a-4cdbe336fa0d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.189760 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e116c6-679a-4667-b79a-4cdbe336fa0d None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.191670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 86/182] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:40:36.193862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 97/183] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:36.197426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a80a-f25b-420e-b182-a4b25c699702 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.197967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a80a-f25b-420e-b182-a4b25c699702 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.198457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9a80a-f25b-420e-b182-a4b25c699702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.216686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-8dd9a80a-f25b-420e-b182-a4b25c699702 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:36.218359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8dd9a80a-f25b-420e-b182-a4b25c699702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:36.220511 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc692ff7-49e8-4f98-825c-555397c233ba None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.220800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc692ff7-49e8-4f98-825c-555397c233ba None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.221079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc692ff7-49e8-4f98-825c-555397c233ba None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.222736 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 98/184] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:40:36.223451 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc692ff7-49e8-4f98-825c-555397c233ba None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:36.289734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 87/185] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:36.289940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964790b-a8bf-4c0d-bf66-a574f545d105 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.290274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964790b-a8bf-4c0d-bf66-a574f545d105 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.290409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964790b-a8bf-4c0d-bf66-a574f545d105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.317674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d964790b-a8bf-4c0d-bf66-a574f545d105 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:36.318817 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d964790b-a8bf-4c0d-bf66-a574f545d105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:36.337476 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc692ff7-49e8-4f98-825c-555397c233ba None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:36.380045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39f60d-f738-4597-b6d8-5234a397a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:36.380790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39f60d-f738-4597-b6d8-5234a397a85d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.381078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39f60d-f738-4597-b6d8-5234a397a85d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.381358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39f60d-f738-4597-b6d8-5234a397a85d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.382564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39f60d-f738-4597-b6d8-5234a397a85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:36.384019 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39f60d-f738-4597-b6d8-5234a397a85d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:36.385655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 99/186] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:36.385655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39f60d-f738-4597-b6d8-5234a397a85d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:36.403372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 88/187] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:36.404306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964790b-a8bf-4c0d-bf66-a574f545d105 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:36.507060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964790b-a8bf-4c0d-bf66-a574f545d105 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:36.509395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39f60d-f738-4597-b6d8-5234a397a85d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:36.539906 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa235-cc50-41ec-a15d-970c33cdc9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:36.540563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa235-cc50-41ec-a15d-970c33cdc9ad None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.540847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa235-cc50-41ec-a15d-970c33cdc9ad None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.541116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aa235-cc50-41ec-a15d-970c33cdc9ad None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.541862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa235-cc50-41ec-a15d-970c33cdc9ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:36.542227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1d8fb-c40b-46fb-96b9-c049648d48cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:36.543036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1d8fb-c40b-46fb-96b9-c049648d48cc None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.543321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1d8fb-c40b-46fb-96b9-c049648d48cc None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.543413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2aa235-cc50-41ec-a15d-970c33cdc9ad None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:36.543598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1d8fb-c40b-46fb-96b9-c049648d48cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.554769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1d8fb-c40b-46fb-96b9-c049648d48cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:36.562864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-49f1d8fb-c40b-46fb-96b9-c049648d48cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:40:36.564122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 100/188] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:40:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:36.564968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1d8fb-c40b-46fb-96b9-c049648d48cc None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:36.566476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 89/189] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:40:36 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:36.569823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa235-cc50-41ec-a15d-970c33cdc9ad None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:36.708073 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aa235-cc50-41ec-a15d-970c33cdc9ad None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:36.714134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1d8fb-c40b-46fb-96b9-c049648d48cc None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:36.755693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c377d-b60c-4be0-8414-5fee1e294c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:36.757015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c377d-b60c-4be0-8414-5fee1e294c05 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.757492 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c377d-b60c-4be0-8414-5fee1e294c05 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.758122 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c377d-b60c-4be0-8414-5fee1e294c05 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.759564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c377d-b60c-4be0-8414-5fee1e294c05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:36.760311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c377d-b60c-4be0-8414-5fee1e294c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:36.761957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c377d-b60c-4be0-8414-5fee1e294c05 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:36.770702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da60416-cabd-4ffe-b4d9-ca88fe78609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:36.770702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da60416-cabd-4ffe-b4d9-ca88fe78609f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.770702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da60416-cabd-4ffe-b4d9-ca88fe78609f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.770702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da60416-cabd-4ffe-b4d9-ca88fe78609f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.773225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 90/190] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:40:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:36.778686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c377d-b60c-4be0-8414-5fee1e294c05 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:36.790923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da60416-cabd-4ffe-b4d9-ca88fe78609f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:36.799453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-3da60416-cabd-4ffe-b4d9-ca88fe78609f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:40:36.800504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 101/191] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:36.808249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da60416-cabd-4ffe-b4d9-ca88fe78609f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:36.926901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c377d-b60c-4be0-8414-5fee1e294c05 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:36.945008 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da60416-cabd-4ffe-b4d9-ca88fe78609f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:36.963952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea786f4-2309-4f00-b2de-d00856fbe94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:36.965094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea786f4-2309-4f00-b2de-d00856fbe94c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.965811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea786f4-2309-4f00-b2de-d00856fbe94c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.966505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea786f4-2309-4f00-b2de-d00856fbe94c None admin] PATH_INFO: `/v3/users/9f5d31c824424a04ac9f5c8975810ede` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.990167 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea786f4-2309-4f00-b2de-d00856fbe94c None admin] RBAC: Authorizing `identity:get_user(user_id=9f5d31c824424a04ac9f5c8975810ede)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:36.991353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cedcd2-df44-4de3-b970-d05b6bc079d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:36.991869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea786f4-2309-4f00-b2de-d00856fbe94c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:36.992191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cedcd2-df44-4de3-b970-d05b6bc079d7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:36.992469 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cedcd2-df44-4de3-b970-d05b6bc079d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:36.992743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cedcd2-df44-4de3-b970-d05b6bc079d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:36.993506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cedcd2-df44-4de3-b970-d05b6bc079d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:36.994131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cedcd2-df44-4de3-b970-d05b6bc079d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:36.994227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 91/192] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:36 2022] GET /identity/v3/users/9f5d31c824424a04ac9f5c8975810ede => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:36.997619 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cedcd2-df44-4de3-b970-d05b6bc079d7 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:37.000614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea786f4-2309-4f00-b2de-d00856fbe94c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:37.006626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 102/193] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:37.012309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cedcd2-df44-4de3-b970-d05b6bc079d7 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:37.160446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cedcd2-df44-4de3-b970-d05b6bc079d7 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:37.179171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea786f4-2309-4f00-b2de-d00856fbe94c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:37.198873 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac695-98a1-40fd-9d9e-f290fc953f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:37.199748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac695-98a1-40fd-9d9e-f290fc953f94 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:37.200025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac695-98a1-40fd-9d9e-f290fc953f94 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:37.200296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac695-98a1-40fd-9d9e-f290fc953f94 None admin] PATH_INFO: `/v3/users/9f5d31c824424a04ac9f5c8975810ede` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:37.202218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ac695-98a1-40fd-9d9e-f290fc953f94 None admin] RBAC: Authorizing `identity:get_user(user_id=9f5d31c824424a04ac9f5c8975810ede)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:37.205458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ac695-98a1-40fd-9d9e-f290fc953f94 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:37.207326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 103/194] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:37 2022] GET /identity/v3/users/9f5d31c824424a04ac9f5c8975810ede => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:37.212766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac695-98a1-40fd-9d9e-f290fc953f94 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:37.241079 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad4392-fde1-4966-a071-fec6af06d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:37.241763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad4392-fde1-4966-a071-fec6af06d5ff None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:37.242219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad4392-fde1-4966-a071-fec6af06d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:37.242320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad4392-fde1-4966-a071-fec6af06d5ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:37.342404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad4392-fde1-4966-a071-fec6af06d5ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:37.344606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad4392-fde1-4966-a071-fec6af06d5ff None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:37.364030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac695-98a1-40fd-9d9e-f290fc953f94 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:37.403254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a06e0a-71a8-4e24-a818-561952a7410e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:37.404256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06e0a-71a8-4e24-a818-561952a7410e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:37.404742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06e0a-71a8-4e24-a818-561952a7410e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:37.405219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06e0a-71a8-4e24-a818-561952a7410e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:37.500940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a06e0a-71a8-4e24-a818-561952a7410e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:37.503047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a06e0a-71a8-4e24-a818-561952a7410e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:37.565391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 92/195] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:37.582624 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad4392-fde1-4966-a071-fec6af06d5ff None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:37.616221 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 104/196] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:37.621059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a06e0a-71a8-4e24-a818-561952a7410e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:37.727581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a06e0a-71a8-4e24-a818-561952a7410e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:37.753675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad4392-fde1-4966-a071-fec6af06d5ff None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:37.780003 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e00f-fd88-4285-a070-021afb598a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:37.781618 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e00f-fd88-4285-a070-021afb598a85 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:37.781919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e00f-fd88-4285-a070-021afb598a85 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:37.782202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899e00f-fd88-4285-a070-021afb598a85 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:37.784342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899e00f-fd88-4285-a070-021afb598a85 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:37.785852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899e00f-fd88-4285-a070-021afb598a85 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:37.787788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 105/197] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:37 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:37.793438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e00f-fd88-4285-a070-021afb598a85 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:37.801908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cde07-9b84-42ca-bab6-a7df3737dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:37.802953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cde07-9b84-42ca-bab6-a7df3737dfbe None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:37.803296 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cde07-9b84-42ca-bab6-a7df3737dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:37.803636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9cde07-9b84-42ca-bab6-a7df3737dfbe None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:37.809599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cde07-9b84-42ca-bab6-a7df3737dfbe None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:37.811241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9cde07-9b84-42ca-bab6-a7df3737dfbe None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:37.814496 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 93/198] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:37 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:37.821533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cde07-9b84-42ca-bab6-a7df3737dfbe None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:37.999253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899e00f-fd88-4285-a070-021afb598a85 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:38.005550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9cde07-9b84-42ca-bab6-a7df3737dfbe None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:38.036774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fc604-6555-4b15-81ef-a2766f0197ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:38.037842 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fc604-6555-4b15-81ef-a2766f0197ac None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:38.038326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fc604-6555-4b15-81ef-a2766f0197ac None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:38.038792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fc604-6555-4b15-81ef-a2766f0197ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:38.039843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fc604-6555-4b15-81ef-a2766f0197ac None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=427007497a734b6ab72d65a07f3dcbb7, user.id=9f5d31c824424a04ac9f5c8975810ede) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:38.040356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fc604-6555-4b15-81ef-a2766f0197ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:38.042040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fc604-6555-4b15-81ef-a2766f0197ac None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:38.048978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 106/199] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:37 2022] GET /identity/v3/role_assignments?user.id=9f5d31c824424a04ac9f5c8975810ede&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=c158bb1781c44a03890992161076b84b => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:38.057758 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8d6fa-a313-4fd4-ab67-a547b66412d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:38.058847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d6fa-a313-4fd4-ab67-a547b66412d3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:38.059336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d6fa-a313-4fd4-ab67-a547b66412d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:38.059813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8d6fa-a313-4fd4-ab67-a547b66412d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:38.060865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8d6fa-a313-4fd4-ab67-a547b66412d3 None admin] RBAC: Adding query filter params (role.id=82e7000d778e4c66a98f07a93e8ae084, scope.project.id=427007497a734b6ab72d65a07f3dcbb7, user.id=9f5d31c824424a04ac9f5c8975810ede) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:38.061378 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8d6fa-a313-4fd4-ab67-a547b66412d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:38.063213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8d6fa-a313-4fd4-ab67-a547b66412d3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:38.069602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 94/200] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:37 2022] GET /identity/v3/role_assignments?user.id=9f5d31c824424a04ac9f5c8975810ede&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=82e7000d778e4c66a98f07a93e8ae084 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:38.274908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920d42-aaf8-46f5-a758-90b8cb0b273a None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:38.275283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920d42-aaf8-46f5-a758-90b8cb0b273a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:38.275456 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22920d42-aaf8-46f5-a758-90b8cb0b273a None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:38.277168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 107/201] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:38.283364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1c5e-66c5-4480-8b52-2e098f0145a5 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:38.284339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1c5e-66c5-4480-8b52-2e098f0145a5 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:38.284824 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1c5e-66c5-4480-8b52-2e098f0145a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:38.309607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-ad9e1c5e-66c5-4480-8b52-2e098f0145a5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:38.311580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ad9e1c5e-66c5-4480-8b52-2e098f0145a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:38.399396 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 95/202] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:38.441195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22920d42-aaf8-46f5-a758-90b8cb0b273a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:38.588812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22920d42-aaf8-46f5-a758-90b8cb0b273a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:38.632570 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1c78c-59c4-481c-82cd-07352ba48acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:38.634178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1c78c-59c4-481c-82cd-07352ba48acf None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:38.634666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1c78c-59c4-481c-82cd-07352ba48acf None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:38.635137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1c78c-59c4-481c-82cd-07352ba48acf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:38.651836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1c78c-59c4-481c-82cd-07352ba48acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:38.659318 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-e7d1c78c-59c4-481c-82cd-07352ba48acf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 12:40:38.665183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 108/203] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:38.666501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e1c5e-66c5-4480-8b52-2e098f0145a5 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:38.806959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e1c5e-66c5-4480-8b52-2e098f0145a5 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:38.860670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0456351-13fa-4407-8dbb-b492b96c2c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:38.861259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0456351-13fa-4407-8dbb-b492b96c2c59 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:38.861536 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0456351-13fa-4407-8dbb-b492b96c2c59 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:38.861833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0456351-13fa-4407-8dbb-b492b96c2c59 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:38.862580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0456351-13fa-4407-8dbb-b492b96c2c59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:38.862881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0456351-13fa-4407-8dbb-b492b96c2c59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:38.864289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0456351-13fa-4407-8dbb-b492b96c2c59 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:38.879382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 96/204] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:38.884787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1c78c-59c4-481c-82cd-07352ba48acf None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:39.026296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1c78c-59c4-481c-82cd-07352ba48acf None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:39.062800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b215e4-50e0-4baa-9323-cf516fef9e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:39.063685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b215e4-50e0-4baa-9323-cf516fef9e4b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:39.063967 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b215e4-50e0-4baa-9323-cf516fef9e4b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:39.064245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b215e4-50e0-4baa-9323-cf516fef9e4b None admin] PATH_INFO: `/v3/users/cef630d1e40a409dbe99ffa61bc34c75` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:39.065465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b215e4-50e0-4baa-9323-cf516fef9e4b None admin] RBAC: Authorizing `identity:get_user(user_id=cef630d1e40a409dbe99ffa61bc34c75)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:39.066964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b215e4-50e0-4baa-9323-cf516fef9e4b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:39.068930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 109/205] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:38 2022] GET /identity/v3/users/cef630d1e40a409dbe99ffa61bc34c75 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:39.074175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0456351-13fa-4407-8dbb-b492b96c2c59 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:39.183088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0456351-13fa-4407-8dbb-b492b96c2c59 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:39.224511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7c57-848c-4a99-a598-339861fdde9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:39.225528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7c57-848c-4a99-a598-339861fdde9f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:39.226037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7c57-848c-4a99-a598-339861fdde9f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:39.226504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7c57-848c-4a99-a598-339861fdde9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:39.296908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e7c57-848c-4a99-a598-339861fdde9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:39.299284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e7c57-848c-4a99-a598-339861fdde9f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:39.400735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 97/206] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:39.407069 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b215e4-50e0-4baa-9323-cf516fef9e4b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:39.574797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b215e4-50e0-4baa-9323-cf516fef9e4b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:39.625884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c0963-365d-4843-8064-e5a6e69eccba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:39.626760 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0963-365d-4843-8064-e5a6e69eccba None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:39.627049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0963-365d-4843-8064-e5a6e69eccba None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:39.627327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c0963-365d-4843-8064-e5a6e69eccba None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:39.634404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c0963-365d-4843-8064-e5a6e69eccba None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:39.635953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c0963-365d-4843-8064-e5a6e69eccba None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:39.638034 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 110/207] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:39 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:39.645044 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7c57-848c-4a99-a598-339861fdde9f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:39.729359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415f972-4c49-4092-8942-dd91f9664dbc None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:39.730003 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415f972-4c49-4092-8942-dd91f9664dbc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:39.730467 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415f972-4c49-4092-8942-dd91f9664dbc None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:39.732015 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 111/208] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:40:39.737271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe3f4-6251-4e36-b5d2-68d8da3b7f1c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:39.737861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe3f4-6251-4e36-b5d2-68d8da3b7f1c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:39.738493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfe3f4-6251-4e36-b5d2-68d8da3b7f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:39.770777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e6cfe3f4-6251-4e36-b5d2-68d8da3b7f1c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:39.774135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e6cfe3f4-6251-4e36-b5d2-68d8da3b7f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:39.802738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7c57-848c-4a99-a598-339861fdde9f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:39.840753 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf8ecc-a065-4b4f-ac32-54d2dc4eb2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:39.841335 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8ecc-a065-4b4f-ac32-54d2dc4eb2ec None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:39.841701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8ecc-a065-4b4f-ac32-54d2dc4eb2ec None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:39.841983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf8ecc-a065-4b4f-ac32-54d2dc4eb2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:39.842876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf8ecc-a065-4b4f-ac32-54d2dc4eb2ec None admin] RBAC: Adding query filter params (role.id=3f30dd1042dd434e99b85ce46f6e84cb, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c, user.id=cef630d1e40a409dbe99ffa61bc34c75) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:39.843490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf8ecc-a065-4b4f-ac32-54d2dc4eb2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:39.845343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf8ecc-a065-4b4f-ac32-54d2dc4eb2ec None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:39.851618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 98/209] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:39 2022] GET /identity/v3/role_assignments?user.id=cef630d1e40a409dbe99ffa61bc34c75&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=3f30dd1042dd434e99b85ce46f6e84cb => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:39.919402 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 112/210] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:39.946630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf8ecc-a065-4b4f-ac32-54d2dc4eb2ec None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:40.017043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e31d7-1a58-4838-bad0-d2c9799eecc4 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:40.017366 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e31d7-1a58-4838-bad0-d2c9799eecc4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:40.017625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e31d7-1a58-4838-bad0-d2c9799eecc4 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:40.021924 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 113/211] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:40:40.027929 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a16cb-d056-4be2-8085-0fecb79a76d0 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:40.028220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a16cb-d056-4be2-8085-0fecb79a76d0 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:40.028493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a16cb-d056-4be2-8085-0fecb79a76d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:40.063435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-f36a16cb-d056-4be2-8085-0fecb79a76d0 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:40.065816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f36a16cb-d056-4be2-8085-0fecb79a76d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:40.121426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf8ecc-a065-4b4f-ac32-54d2dc4eb2ec None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:40.162384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0763-6d7a-4414-8ce5-16270f9f5e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:40.163244 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0763-6d7a-4414-8ce5-16270f9f5e75 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:40.163534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0763-6d7a-4414-8ce5-16270f9f5e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:40.163813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f0763-6d7a-4414-8ce5-16270f9f5e75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:40.177524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f0763-6d7a-4414-8ce5-16270f9f5e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:40.183894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 114/212] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:40.184936 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-e99f0763-6d7a-4414-8ce5-16270f9f5e75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:40.186442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 99/213] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:40.192562 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a16cb-d056-4be2-8085-0fecb79a76d0 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:40.217204 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0763-6d7a-4414-8ce5-16270f9f5e75 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:40.304724 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a16cb-d056-4be2-8085-0fecb79a76d0 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:40.330058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f0763-6d7a-4414-8ce5-16270f9f5e75 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:40.351931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb86df7-7ede-4e52-97d9-e3fb2e7c0bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:40.352863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb86df7-7ede-4e52-97d9-e3fb2e7c0bc4 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:40.353281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb86df7-7ede-4e52-97d9-e3fb2e7c0bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:40.353729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb86df7-7ede-4e52-97d9-e3fb2e7c0bc4 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:40.354611 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb86df7-7ede-4e52-97d9-e3fb2e7c0bc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:40.355053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb86df7-7ede-4e52-97d9-e3fb2e7c0bc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:40.356595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb86df7-7ede-4e52-97d9-e3fb2e7c0bc4 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:40.366125 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a9c2-b369-4e12-9912-59a79a32881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:40.366557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 115/214] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:40.367162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a9c2-b369-4e12-9912-59a79a32881a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:40.367272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a9c2-b369-4e12-9912-59a79a32881a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:40.367474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a9c2-b369-4e12-9912-59a79a32881a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:40.368741 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6a9c2-b369-4e12-9912-59a79a32881a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:40.371238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6a9c2-b369-4e12-9912-59a79a32881a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:40.372177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 100/215] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:40.372787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb86df7-7ede-4e52-97d9-e3fb2e7c0bc4 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:40.379137 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a9c2-b369-4e12-9912-59a79a32881a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:40.493540 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a9c2-b369-4e12-9912-59a79a32881a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:40.508098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb86df7-7ede-4e52-97d9-e3fb2e7c0bc4 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:40.529932 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f682a-d0b8-48f8-9b14-6d954b45e218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:40.531888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f682a-d0b8-48f8-9b14-6d954b45e218 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:40.532183 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f682a-d0b8-48f8-9b14-6d954b45e218 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:40.532717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f682a-d0b8-48f8-9b14-6d954b45e218 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:40.533930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f682a-d0b8-48f8-9b14-6d954b45e218 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:40.535481 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f682a-d0b8-48f8-9b14-6d954b45e218 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:40.550287 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1bff0-775b-4cae-947b-15d579c07d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:40.551416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bff0-775b-4cae-947b-15d579c07d23 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:40.551696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bff0-775b-4cae-947b-15d579c07d23 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:40.552123 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bff0-775b-4cae-947b-15d579c07d23 None admin] PATH_INFO: `/v3/users/525d9eecfa824ce192be4965cbeedb49` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:40.560380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 101/216] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:40:40 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:40.568532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1bff0-775b-4cae-947b-15d579c07d23 None admin] RBAC: Authorizing `identity:get_user(user_id=525d9eecfa824ce192be4965cbeedb49)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:40.570132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1bff0-775b-4cae-947b-15d579c07d23 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:40.572206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 116/217] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:40 2022] GET /identity/v3/users/525d9eecfa824ce192be4965cbeedb49 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:40.578169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f682a-d0b8-48f8-9b14-6d954b45e218 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:40.693923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f682a-d0b8-48f8-9b14-6d954b45e218 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:40.734870 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d7eec-f4ef-43e1-89ef-e59eb8bf1a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:40.735889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7eec-f4ef-43e1-89ef-e59eb8bf1a69 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:40.736350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7eec-f4ef-43e1-89ef-e59eb8bf1a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:40.736795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7eec-f4ef-43e1-89ef-e59eb8bf1a69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:40.806207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d7eec-f4ef-43e1-89ef-e59eb8bf1a69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:40.808016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d7eec-f4ef-43e1-89ef-e59eb8bf1a69 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:40.906923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 102/218] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:40.907585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741a2dd-0362-4618-ab4d-2f036263230e None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:40.908062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741a2dd-0362-4618-ab4d-2f036263230e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:40.908311 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741a2dd-0362-4618-ab4d-2f036263230e None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:40.911163 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 117/219] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:40.914432 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d7eec-f4ef-43e1-89ef-e59eb8bf1a69 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:40.919341 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7373331-d737-46ea-8b1f-e1f67032a5d9 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:40.921964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7373331-d737-46ea-8b1f-e1f67032a5d9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:40.922244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7373331-d737-46ea-8b1f-e1f67032a5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:40.945552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-a7373331-d737-46ea-8b1f-e1f67032a5d9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:40.946694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a7373331-d737-46ea-8b1f-e1f67032a5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:41.042871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 118/220] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:41.055498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d7eec-f4ef-43e1-89ef-e59eb8bf1a69 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:41.068068 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7373331-d737-46ea-8b1f-e1f67032a5d9 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:41.097165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a296db3-4fcf-4958-b526-d65af2fcc731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:41.098851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296db3-4fcf-4958-b526-d65af2fcc731 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:41.099572 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296db3-4fcf-4958-b526-d65af2fcc731 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:41.100039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a296db3-4fcf-4958-b526-d65af2fcc731 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:41.102161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a296db3-4fcf-4958-b526-d65af2fcc731 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:41.104308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a296db3-4fcf-4958-b526-d65af2fcc731 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:41.106672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 103/221] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:40 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:41.113120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a296db3-4fcf-4958-b526-d65af2fcc731 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:41.188547 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7373331-d737-46ea-8b1f-e1f67032a5d9 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:41.228241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a296db3-4fcf-4958-b526-d65af2fcc731 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:41.233644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ca44d-4ca7-4792-b7f4-1269d2300e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:41.234722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca44d-4ca7-4792-b7f4-1269d2300e44 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:41.235195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca44d-4ca7-4792-b7f4-1269d2300e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:41.236038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ca44d-4ca7-4792-b7f4-1269d2300e44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:41.249876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ca44d-4ca7-4792-b7f4-1269d2300e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:41.259750 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-695ca44d-4ca7-4792-b7f4-1269d2300e44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:40:41.261152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0389813-54e0-4c52-94d2-fcba4790ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:41.261660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 119/222] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:40:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:41.261859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389813-54e0-4c52-94d2-fcba4790ab43 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:41.262145 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389813-54e0-4c52-94d2-fcba4790ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:41.262422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0389813-54e0-4c52-94d2-fcba4790ab43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:41.263261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0389813-54e0-4c52-94d2-fcba4790ab43 None admin] RBAC: Adding query filter params (role.id=9b6d2d07e37f449699fd25de81ee509a, scope.project.id=427007497a734b6ab72d65a07f3dcbb7, user.id=525d9eecfa824ce192be4965cbeedb49) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:41.263585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0389813-54e0-4c52-94d2-fcba4790ab43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:41.264075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2862-f724-44f7-85b4-c3bd20230bed None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:41.264541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2862-f724-44f7-85b4-c3bd20230bed None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:41.265605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2862-f724-44f7-85b4-c3bd20230bed None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:41.265704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0389813-54e0-4c52-94d2-fcba4790ab43 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:41.267156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 120/223] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:41.268208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d2862-f724-44f7-85b4-c3bd20230bed None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:41.275896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 104/224] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:41 2022] GET /identity/v3/role_assignments?user.id=525d9eecfa824ce192be4965cbeedb49&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:41.283404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7751b7d-2b39-41ca-9d8c-f7705f8c84b2 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:41.283404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7751b7d-2b39-41ca-9d8c-f7705f8c84b2 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:41.283404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7751b7d-2b39-41ca-9d8c-f7705f8c84b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:41.313676 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-a7751b7d-2b39-41ca-9d8c-f7705f8c84b2 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:41.316117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a7751b7d-2b39-41ca-9d8c-f7705f8c84b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:41.456900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 105/225] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:41.467333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d2862-f724-44f7-85b4-c3bd20230bed None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:41.495184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7751b7d-2b39-41ca-9d8c-f7705f8c84b2 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:41.523166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9343b20-81d7-458d-a0cd-e4d2030c6f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:41.524178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9343b20-81d7-458d-a0cd-e4d2030c6f14 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:41.524802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9343b20-81d7-458d-a0cd-e4d2030c6f14 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:41.525270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9343b20-81d7-458d-a0cd-e4d2030c6f14 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:41.526464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9343b20-81d7-458d-a0cd-e4d2030c6f14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:41.526913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9343b20-81d7-458d-a0cd-e4d2030c6f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:41.528435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9343b20-81d7-458d-a0cd-e4d2030c6f14 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:41.541838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 121/226] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:41.549013 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9343b20-81d7-458d-a0cd-e4d2030c6f14 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:41.643673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7751b7d-2b39-41ca-9d8c-f7705f8c84b2 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:41.711247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef212c-1313-4787-93b9-0d704c99997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:41.712517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef212c-1313-4787-93b9-0d704c99997a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:41.712996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef212c-1313-4787-93b9-0d704c99997a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:41.713464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef212c-1313-4787-93b9-0d704c99997a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:41.715612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9343b20-81d7-458d-a0cd-e4d2030c6f14 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:41.742640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef212c-1313-4787-93b9-0d704c99997a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:41.750750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-63ef212c-1313-4787-93b9-0d704c99997a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:40:41.754426 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83444e0b-d266-47d0-9fbb-fb00be56fe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:41.755301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83444e0b-d266-47d0-9fbb-fb00be56fe7f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:41.755587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83444e0b-d266-47d0-9fbb-fb00be56fe7f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:41.755865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83444e0b-d266-47d0-9fbb-fb00be56fe7f None admin] PATH_INFO: `/v3/users/9f5d31c824424a04ac9f5c8975810ede` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:41.757078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83444e0b-d266-47d0-9fbb-fb00be56fe7f None admin] RBAC: Authorizing `identity:get_user(user_id=9f5d31c824424a04ac9f5c8975810ede)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:41.758627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83444e0b-d266-47d0-9fbb-fb00be56fe7f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:41.760624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 122/227] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:41 2022] GET /identity/v3/users/9f5d31c824424a04ac9f5c8975810ede => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:41.761723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 106/228] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:40:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:41.770908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83444e0b-d266-47d0-9fbb-fb00be56fe7f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:41.772241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef212c-1313-4787-93b9-0d704c99997a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:41.885180 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83444e0b-d266-47d0-9fbb-fb00be56fe7f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:41.922235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74e7c3-50d7-4704-a234-1f2443539393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:41.926075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e7c3-50d7-4704-a234-1f2443539393 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:41.926572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e7c3-50d7-4704-a234-1f2443539393 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:41.927079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e7c3-50d7-4704-a234-1f2443539393 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:41.932871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74e7c3-50d7-4704-a234-1f2443539393 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:41.934615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74e7c3-50d7-4704-a234-1f2443539393 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:41.942004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 123/229] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:41 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:41.945760 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74e7c3-50d7-4704-a234-1f2443539393 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:41.985835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef212c-1313-4787-93b9-0d704c99997a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:42.024766 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544dbbc-7923-4a30-9fa8-259dfb66e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:42.025851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544dbbc-7923-4a30-9fa8-259dfb66e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:42.026630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544dbbc-7923-4a30-9fa8-259dfb66e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:42.027147 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544dbbc-7923-4a30-9fa8-259dfb66e3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:42.028138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544dbbc-7923-4a30-9fa8-259dfb66e3b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:42.028646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544dbbc-7923-4a30-9fa8-259dfb66e3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:42.030833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544dbbc-7923-4a30-9fa8-259dfb66e3b2 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:42.045716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 107/230] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:40:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:42.050335 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544dbbc-7923-4a30-9fa8-259dfb66e3b2 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:42.154707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74e7c3-50d7-4704-a234-1f2443539393 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:42.160467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544dbbc-7923-4a30-9fa8-259dfb66e3b2 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:42.195839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c189f-03ce-43d0-bf56-490b2d11ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:42.197157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c189f-03ce-43d0-bf56-490b2d11ddec None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:42.197773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfdd2a-e7cd-4567-aaf1-5663e4f2266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:42.198108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c189f-03ce-43d0-bf56-490b2d11ddec None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:42.198581 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c189f-03ce-43d0-bf56-490b2d11ddec None admin] PATH_INFO: `/v3/users/9f5d31c824424a04ac9f5c8975810ede` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:42.198680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfdd2a-e7cd-4567-aaf1-5663e4f2266d None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:42.198932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfdd2a-e7cd-4567-aaf1-5663e4f2266d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:42.199212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfdd2a-e7cd-4567-aaf1-5663e4f2266d None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7/users/9f5d31c824424a04ac9f5c8975810ede/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:42.200583 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c189f-03ce-43d0-bf56-490b2d11ddec None admin] RBAC: Authorizing `identity:get_user(user_id=9f5d31c824424a04ac9f5c8975810ede)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:42.202680 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c189f-03ce-43d0-bf56-490b2d11ddec None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:42.209172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfdd2a-e7cd-4567-aaf1-5663e4f2266d None admin] RBAC: Authorizing `identity:create_grant(project_id=427007497a734b6ab72d65a07f3dcbb7, user_id=9f5d31c824424a04ac9f5c8975810ede, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:42.209172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfdd2a-e7cd-4567-aaf1-5663e4f2266d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:42.209547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 108/231] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:42 2022] GET /identity/v3/users/9f5d31c824424a04ac9f5c8975810ede => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:42.210949 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c189f-03ce-43d0-bf56-490b2d11ddec None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:42.234189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 124/232] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:40:41 2022] PUT /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7/users/9f5d31c824424a04ac9f5c8975810ede/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:42.342143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c189f-03ce-43d0-bf56-490b2d11ddec None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:42.376564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2351b3-d0bc-46ee-b6a7-80ff1586308c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:42.377453 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2351b3-d0bc-46ee-b6a7-80ff1586308c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:42.377761 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2351b3-d0bc-46ee-b6a7-80ff1586308c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:42.378038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2351b3-d0bc-46ee-b6a7-80ff1586308c None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:42.379269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2351b3-d0bc-46ee-b6a7-80ff1586308c None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:42.380773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2351b3-d0bc-46ee-b6a7-80ff1586308c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:42.385930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 109/233] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:42 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:42.388818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfdd2a-e7cd-4567-aaf1-5663e4f2266d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:42.510042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfdd2a-e7cd-4567-aaf1-5663e4f2266d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:42.547464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb46070-8354-427b-9e73-e7e7df2c6197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:42.548330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb46070-8354-427b-9e73-e7e7df2c6197 None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:42.548622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb46070-8354-427b-9e73-e7e7df2c6197 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:42.548901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb46070-8354-427b-9e73-e7e7df2c6197 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7/users/9f5d31c824424a04ac9f5c8975810ede/roles/82e7000d778e4c66a98f07a93e8ae084` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:42.551620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb46070-8354-427b-9e73-e7e7df2c6197 None admin] RBAC: Authorizing `identity:create_grant(project_id=427007497a734b6ab72d65a07f3dcbb7, user_id=9f5d31c824424a04ac9f5c8975810ede, role_id=82e7000d778e4c66a98f07a93e8ae084)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:42.554503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb46070-8354-427b-9e73-e7e7df2c6197 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:42.571653 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 125/234] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:40:42 2022] PUT /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7/users/9f5d31c824424a04ac9f5c8975810ede/roles/82e7000d778e4c66a98f07a93e8ae084 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:43.444377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33aa8c-c494-4139-8588-ad3397279e49 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:43.444872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33aa8c-c494-4139-8588-ad3397279e49 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:43.444946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33aa8c-c494-4139-8588-ad3397279e49 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:43.446885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 110/235] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:43.453751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255755a0-d3cc-4848-a5db-25f94bd40f77 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:43.454177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255755a0-d3cc-4848-a5db-25f94bd40f77 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:43.454349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255755a0-d3cc-4848-a5db-25f94bd40f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:43.471921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-255755a0-d3cc-4848-a5db-25f94bd40f77 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:43.473127 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-255755a0-d3cc-4848-a5db-25f94bd40f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:43.566009 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 126/236] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:43.606029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33aa8c-c494-4139-8588-ad3397279e49 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:43.725140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33aa8c-c494-4139-8588-ad3397279e49 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:43.765998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3ab64-1a71-4804-b76e-033ae619ed3e None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:43.766467 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3ab64-1a71-4804-b76e-033ae619ed3e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:43.766898 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3ab64-1a71-4804-b76e-033ae619ed3e None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:43.769320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18b1d5-fce1-4894-b850-94c468753b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:43.769482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 127/237] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:40:43.770188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18b1d5-fce1-4894-b850-94c468753b1c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:43.770472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18b1d5-fce1-4894-b850-94c468753b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:43.770752 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18b1d5-fce1-4894-b850-94c468753b1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:43.777175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851498f-0501-4850-a516-36a7c7abeff5 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:43.777969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851498f-0501-4850-a516-36a7c7abeff5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:43.778255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851498f-0501-4850-a516-36a7c7abeff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:43.793633 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18b1d5-fce1-4894-b850-94c468753b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:43.799183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e851498f-0501-4850-a516-36a7c7abeff5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:43.800781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e851498f-0501-4850-a516-36a7c7abeff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:43.801499 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-aa18b1d5-fce1-4894-b850-94c468753b1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 12:40:43.810081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 111/238] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:43.816376 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18b1d5-fce1-4894-b850-94c468753b1c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:43.912214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 128/239] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:43.973826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18b1d5-fce1-4894-b850-94c468753b1c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:43.983177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851498f-0501-4850-a516-36a7c7abeff5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:44.047366 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5c97e-f9df-4401-b3f3-d8f6a13d9271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:44.048055 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c97e-f9df-4401-b3f3-d8f6a13d9271 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:44.048339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c97e-f9df-4401-b3f3-d8f6a13d9271 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:44.048618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c97e-f9df-4401-b3f3-d8f6a13d9271 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:44.049376 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5c97e-f9df-4401-b3f3-d8f6a13d9271 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:44.049710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5c97e-f9df-4401-b3f3-d8f6a13d9271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:44.051384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5c97e-f9df-4401-b3f3-d8f6a13d9271 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:44.069229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 112/240] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:44.074888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5c97e-f9df-4401-b3f3-d8f6a13d9271 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:44.104524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851498f-0501-4850-a516-36a7c7abeff5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:44.143600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee5762-84ee-4714-b612-3056ee4c0fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:44.144494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee5762-84ee-4714-b612-3056ee4c0fda None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:44.144834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee5762-84ee-4714-b612-3056ee4c0fda None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:44.145169 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee5762-84ee-4714-b612-3056ee4c0fda None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:44.146490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee5762-84ee-4714-b612-3056ee4c0fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:44.148152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee5762-84ee-4714-b612-3056ee4c0fda None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:44.150457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 129/241] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:44.158658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee5762-84ee-4714-b612-3056ee4c0fda None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:44.204166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5c97e-f9df-4401-b3f3-d8f6a13d9271 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:44.237930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d75f24-b775-4c21-bc1a-efb5cb580d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:44.238837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d75f24-b775-4c21-bc1a-efb5cb580d3f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:44.239117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d75f24-b775-4c21-bc1a-efb5cb580d3f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:44.239392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d75f24-b775-4c21-bc1a-efb5cb580d3f None admin] PATH_INFO: `/v3/users/e48bbd6bcdb846fca2222808caa015d6` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:44.255793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d75f24-b775-4c21-bc1a-efb5cb580d3f None admin] RBAC: Authorizing `identity:get_user(user_id=e48bbd6bcdb846fca2222808caa015d6)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:44.257318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d75f24-b775-4c21-bc1a-efb5cb580d3f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:44.259397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 113/242] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:44 2022] GET /identity/v3/users/e48bbd6bcdb846fca2222808caa015d6 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:44.260661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed76e-3757-4680-baa3-dda62afa2c87 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:44.260943 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed76e-3757-4680-baa3-dda62afa2c87 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:44.261218 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bed76e-3757-4680-baa3-dda62afa2c87 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:44.262468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 114/243] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:44.268320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bed76e-3757-4680-baa3-dda62afa2c87 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:44.287706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee5762-84ee-4714-b612-3056ee4c0fda None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:44.326480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8114a38-adb3-4510-8718-79d8dc92a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:44.326811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114a38-adb3-4510-8718-79d8dc92a40c None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:44.326961 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114a38-adb3-4510-8718-79d8dc92a40c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:44.327555 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114a38-adb3-4510-8718-79d8dc92a40c None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:44.330952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8114a38-adb3-4510-8718-79d8dc92a40c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:44.330952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8114a38-adb3-4510-8718-79d8dc92a40c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:44.356670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 130/244] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:40:44 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:44.360019 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166e078-b258-41ca-973a-bf50e07501d1 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:44.360537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166e078-b258-41ca-973a-bf50e07501d1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:44.361441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166e078-b258-41ca-973a-bf50e07501d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:44.391947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bed76e-3757-4680-baa3-dda62afa2c87 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:44.403920 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5166e078-b258-41ca-973a-bf50e07501d1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:44.407681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5166e078-b258-41ca-973a-bf50e07501d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:44.472211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c5e3-d8ec-4e79-ba43-cbd1ac71dc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:44.473520 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c5e3-d8ec-4e79-ba43-cbd1ac71dc65 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:44.474022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c5e3-d8ec-4e79-ba43-cbd1ac71dc65 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:44.474469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c5e3-d8ec-4e79-ba43-cbd1ac71dc65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:44.555677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c5e3-d8ec-4e79-ba43-cbd1ac71dc65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:44.557558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c5e3-d8ec-4e79-ba43-cbd1ac71dc65 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:44.582964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 131/245] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:44.609546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166e078-b258-41ca-973a-bf50e07501d1 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:44.670430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 115/246] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:44.676397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c5e3-d8ec-4e79-ba43-cbd1ac71dc65 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:44.757787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166e078-b258-41ca-973a-bf50e07501d1 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:44.809879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95818e4a-87e0-42dd-8340-751183b72c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:44.812369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95818e4a-87e0-42dd-8340-751183b72c97 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:44.812986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95818e4a-87e0-42dd-8340-751183b72c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:44.813523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95818e4a-87e0-42dd-8340-751183b72c97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:44.834251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95818e4a-87e0-42dd-8340-751183b72c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:44.835714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c5e3-d8ec-4e79-ba43-cbd1ac71dc65 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:44.842990 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-95818e4a-87e0-42dd-8340-751183b72c97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:44.844801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 132/247] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:40:44.856876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95818e4a-87e0-42dd-8340-751183b72c97 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:44.889514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff0f65-3669-4391-a1e4-92cd9733cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:44.891080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0f65-3669-4391-a1e4-92cd9733cd80 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:44.891563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0f65-3669-4391-a1e4-92cd9733cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:44.892145 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0f65-3669-4391-a1e4-92cd9733cd80 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:44.893748 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff0f65-3669-4391-a1e4-92cd9733cd80 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:44.895392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff0f65-3669-4391-a1e4-92cd9733cd80 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:44.900423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 116/248] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:44 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:44.910955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff0f65-3669-4391-a1e4-92cd9733cd80 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:44.996912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95818e4a-87e0-42dd-8340-751183b72c97 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:45.033463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541104-3d91-4e5d-9d71-a98c29d3ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:45.033762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541104-3d91-4e5d-9d71-a98c29d3ace0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.034029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541104-3d91-4e5d-9d71-a98c29d3ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.034310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8541104-3d91-4e5d-9d71-a98c29d3ace0 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:45.035075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8541104-3d91-4e5d-9d71-a98c29d3ace0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:45.035391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8541104-3d91-4e5d-9d71-a98c29d3ace0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:45.036790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8541104-3d91-4e5d-9d71-a98c29d3ace0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:45.045464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 133/249] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:45.053452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541104-3d91-4e5d-9d71-a98c29d3ace0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:45.060682 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff0f65-3669-4391-a1e4-92cd9733cd80 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:45.103128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703a9b2-cfd5-4233-be9a-d254ba681eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:45.104514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703a9b2-cfd5-4233-be9a-d254ba681eda None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.105232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703a9b2-cfd5-4233-be9a-d254ba681eda None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.105804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703a9b2-cfd5-4233-be9a-d254ba681eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:45.107344 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703a9b2-cfd5-4233-be9a-d254ba681eda None admin] RBAC: Adding query filter params (role.id=3f30dd1042dd434e99b85ce46f6e84cb, scope.project.id=427007497a734b6ab72d65a07f3dcbb7, user.id=e48bbd6bcdb846fca2222808caa015d6) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:45.107983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703a9b2-cfd5-4233-be9a-d254ba681eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:45.110978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703a9b2-cfd5-4233-be9a-d254ba681eda None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:45.119135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 117/250] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:44 2022] GET /identity/v3/role_assignments?user.id=e48bbd6bcdb846fca2222808caa015d6&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=3f30dd1042dd434e99b85ce46f6e84cb => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:45.162310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8541104-3d91-4e5d-9d71-a98c29d3ace0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:45.201506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5e2f6-b5f3-49dd-833d-d74bf286d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:45.202486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5e2f6-b5f3-49dd-833d-d74bf286d3ca None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.202819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5e2f6-b5f3-49dd-833d-d74bf286d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.203048 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5e2f6-b5f3-49dd-833d-d74bf286d3ca None admin] PATH_INFO: `/v3/users/525d9eecfa824ce192be4965cbeedb49` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:45.204679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5e2f6-b5f3-49dd-833d-d74bf286d3ca None admin] RBAC: Authorizing `identity:get_user(user_id=525d9eecfa824ce192be4965cbeedb49)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:45.206238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5e2f6-b5f3-49dd-833d-d74bf286d3ca None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:45.208301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 134/251] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:45 2022] GET /identity/v3/users/525d9eecfa824ce192be4965cbeedb49 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:45.214250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703a9b2-cfd5-4233-be9a-d254ba681eda None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:45.323375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f27b-951b-4280-8fd6-8c3f9aa19e1d None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.323575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f27b-951b-4280-8fd6-8c3f9aa19e1d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.323836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f27b-951b-4280-8fd6-8c3f9aa19e1d None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:45.335910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 135/252] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:45 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:45.341760 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2196-19b3-41f6-b7c8-d2aef90e064a None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.342067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2196-19b3-41f6-b7c8-d2aef90e064a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.342330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2196-19b3-41f6-b7c8-d2aef90e064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:45.356530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703a9b2-cfd5-4233-be9a-d254ba681eda None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:45.369956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-1def2196-19b3-41f6-b7c8-d2aef90e064a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:45.371151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1def2196-19b3-41f6-b7c8-d2aef90e064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:45.418298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd4f86-5f3d-4a9c-969b-3279343e539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:45.419162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd4f86-5f3d-4a9c-969b-3279343e539a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.419438 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd4f86-5f3d-4a9c-969b-3279343e539a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.419706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd4f86-5f3d-4a9c-969b-3279343e539a None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:45.421549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd4f86-5f3d-4a9c-969b-3279343e539a None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:45.423073 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd4f86-5f3d-4a9c-969b-3279343e539a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:45.426741 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 118/253] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:45 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:45.430849 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd4f86-5f3d-4a9c-969b-3279343e539a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:45.473806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 136/254] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:45.515645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2196-19b3-41f6-b7c8-d2aef90e064a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:45.600652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd4f86-5f3d-4a9c-969b-3279343e539a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:45.657433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc08c4-5cf2-4e2c-9c3e-2d5ce0968922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:45.660590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc08c4-5cf2-4e2c-9c3e-2d5ce0968922 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.660871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc08c4-5cf2-4e2c-9c3e-2d5ce0968922 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.661145 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc08c4-5cf2-4e2c-9c3e-2d5ce0968922 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7/users/525d9eecfa824ce192be4965cbeedb49/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:45.668209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc08c4-5cf2-4e2c-9c3e-2d5ce0968922 None admin] RBAC: Authorizing `identity:create_grant(project_id=427007497a734b6ab72d65a07f3dcbb7, user_id=525d9eecfa824ce192be4965cbeedb49, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:45.669734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc08c4-5cf2-4e2c-9c3e-2d5ce0968922 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:45.699868 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 119/255] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:40:45 2022] PUT /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7/users/525d9eecfa824ce192be4965cbeedb49/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:45.716180 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2196-19b3-41f6-b7c8-d2aef90e064a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:45.756884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcc42a-7da7-4b4d-8f98-ec97b4954960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:45.757725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc42a-7da7-4b4d-8f98-ec97b4954960 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.758006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc42a-7da7-4b4d-8f98-ec97b4954960 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.758275 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcc42a-7da7-4b4d-8f98-ec97b4954960 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:45.770366 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcc42a-7da7-4b4d-8f98-ec97b4954960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:45.777504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-d4dcc42a-7da7-4b4d-8f98-ec97b4954960 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:40:45.779137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 137/256] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:40:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:40:45.785006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc08c4-5cf2-4e2c-9c3e-2d5ce0968922 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:45.927626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc08c4-5cf2-4e2c-9c3e-2d5ce0968922 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:45.974410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ef022-ffcb-4c7c-b7e1-a3d2d51d2a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:45.975088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef022-ffcb-4c7c-b7e1-a3d2d51d2a99 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.975365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef022-ffcb-4c7c-b7e1-a3d2d51d2a99 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.975636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ef022-ffcb-4c7c-b7e1-a3d2d51d2a99 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:45.976385 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ef022-ffcb-4c7c-b7e1-a3d2d51d2a99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:45.976694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ef022-ffcb-4c7c-b7e1-a3d2d51d2a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:45.978156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ef022-ffcb-4c7c-b7e1-a3d2d51d2a99 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:45.987330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 120/257] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:45.988974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67976-2433-4c9a-80fd-c7ed3d7c1d11 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.989269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67976-2433-4c9a-80fd-c7ed3d7c1d11 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.989642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d67976-2433-4c9a-80fd-c7ed3d7c1d11 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:45.992062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 138/258] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:40:45.996322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24846c7-7c52-484b-9d27-0dfc11f4778f None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:45.996630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24846c7-7c52-484b-9d27-0dfc11f4778f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:45.996793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d67976-2433-4c9a-80fd-c7ed3d7c1d11 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:45.996887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24846c7-7c52-484b-9d27-0dfc11f4778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:46.017112 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c24846c7-7c52-484b-9d27-0dfc11f4778f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:46.018440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c24846c7-7c52-484b-9d27-0dfc11f4778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:46.127258 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d67976-2433-4c9a-80fd-c7ed3d7c1d11 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:46.140311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 121/259] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:46.181204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec304b9-2add-43e4-9a5e-3dd3581a919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:46.182040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec304b9-2add-43e4-9a5e-3dd3581a919c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:46.182326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec304b9-2add-43e4-9a5e-3dd3581a919c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:46.182597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec304b9-2add-43e4-9a5e-3dd3581a919c None admin] PATH_INFO: `/v3/users/9f5d31c824424a04ac9f5c8975810ede` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:46.186505 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec304b9-2add-43e4-9a5e-3dd3581a919c None admin] RBAC: Authorizing `identity:get_user(user_id=9f5d31c824424a04ac9f5c8975810ede)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:46.189048 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec304b9-2add-43e4-9a5e-3dd3581a919c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:46.190884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 139/260] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:45 2022] GET /identity/v3/users/9f5d31c824424a04ac9f5c8975810ede => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:46.196803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec304b9-2add-43e4-9a5e-3dd3581a919c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:46.196946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24846c7-7c52-484b-9d27-0dfc11f4778f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:46.342002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24846c7-7c52-484b-9d27-0dfc11f4778f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:46.385284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33c512-6def-42fd-a313-b5f27cc34d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:46.386473 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33c512-6def-42fd-a313-b5f27cc34d4a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:46.386958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33c512-6def-42fd-a313-b5f27cc34d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:46.387451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33c512-6def-42fd-a313-b5f27cc34d4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:46.408077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec304b9-2add-43e4-9a5e-3dd3581a919c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:46.409214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33c512-6def-42fd-a313-b5f27cc34d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:46.425210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-3c33c512-6def-42fd-a313-b5f27cc34d4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:40:46.427855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 122/261] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:40:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:46.432968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33c512-6def-42fd-a313-b5f27cc34d4a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:46.465168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3d593-9130-415b-841d-766c2c425185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:46.466762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d593-9130-415b-841d-766c2c425185 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:46.467029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d593-9130-415b-841d-766c2c425185 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:46.467535 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d593-9130-415b-841d-766c2c425185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:46.619789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3d593-9130-415b-841d-766c2c425185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:46.621281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3d593-9130-415b-841d-766c2c425185 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:46.652985 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33c512-6def-42fd-a313-b5f27cc34d4a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:46.743768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2a49-ed37-4451-b229-93d1f5da3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:46.744368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2a49-ed37-4451-b229-93d1f5da3767 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:46.744654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2a49-ed37-4451-b229-93d1f5da3767 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:46.744932 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb2a49-ed37-4451-b229-93d1f5da3767 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:46.745730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2a49-ed37-4451-b229-93d1f5da3767 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:46.746042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2a49-ed37-4451-b229-93d1f5da3767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:46.747461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb2a49-ed37-4451-b229-93d1f5da3767 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:46.756613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 140/262] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:46.762626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3d593-9130-415b-841d-766c2c425185 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:46.765048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 123/263] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:40:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:46.770520 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2a49-ed37-4451-b229-93d1f5da3767 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:46.912566 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3d593-9130-415b-841d-766c2c425185 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:46.975635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4706ad9-ffdd-4250-893e-f010e010ea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:46.976505 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4706ad9-ffdd-4250-893e-f010e010ea40 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:46.976785 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4706ad9-ffdd-4250-893e-f010e010ea40 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:46.977059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4706ad9-ffdd-4250-893e-f010e010ea40 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:46.982308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4706ad9-ffdd-4250-893e-f010e010ea40 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:46.984449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4706ad9-ffdd-4250-893e-f010e010ea40 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:46.986614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 141/264] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:46 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:46.992314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4706ad9-ffdd-4250-893e-f010e010ea40 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:47.029219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb2a49-ed37-4451-b229-93d1f5da3767 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:47.099691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be35c6-bded-426a-ad82-4468cc1bc85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:47.100583 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be35c6-bded-426a-ad82-4468cc1bc85c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:47.100865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be35c6-bded-426a-ad82-4468cc1bc85c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:47.101139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be35c6-bded-426a-ad82-4468cc1bc85c None admin] PATH_INFO: `/v3/users/9f5d31c824424a04ac9f5c8975810ede` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:47.106282 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be35c6-bded-426a-ad82-4468cc1bc85c None admin] RBAC: Authorizing `identity:get_user(user_id=9f5d31c824424a04ac9f5c8975810ede)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:47.107779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be35c6-bded-426a-ad82-4468cc1bc85c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:47.109786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 124/265] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:46 2022] GET /identity/v3/users/9f5d31c824424a04ac9f5c8975810ede => generated 283 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:47.115151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be35c6-bded-426a-ad82-4468cc1bc85c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:47.184248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4706ad9-ffdd-4250-893e-f010e010ea40 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:47.260138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2299b-bc15-4633-9be4-66ebd3547dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:47.260803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2299b-bc15-4633-9be4-66ebd3547dee None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:47.261087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2299b-bc15-4633-9be4-66ebd3547dee None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:47.261360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2299b-bc15-4633-9be4-66ebd3547dee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:47.262229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2299b-bc15-4633-9be4-66ebd3547dee None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=427007497a734b6ab72d65a07f3dcbb7, user.id=9f5d31c824424a04ac9f5c8975810ede) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:47.262539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2299b-bc15-4633-9be4-66ebd3547dee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:47.264008 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2299b-bc15-4633-9be4-66ebd3547dee None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:47.278141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 142/266] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:46 2022] GET /identity/v3/role_assignments?user.id=9f5d31c824424a04ac9f5c8975810ede&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=c158bb1781c44a03890992161076b84b => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:47.341918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be35c6-bded-426a-ad82-4468cc1bc85c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:47.399816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf31949-2d5a-497b-9e57-52bf19e18f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:47.400494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31949-2d5a-497b-9e57-52bf19e18f94 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:47.400778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31949-2d5a-497b-9e57-52bf19e18f94 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:47.401056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31949-2d5a-497b-9e57-52bf19e18f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:47.480048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf31949-2d5a-497b-9e57-52bf19e18f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:47.481606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf31949-2d5a-497b-9e57-52bf19e18f94 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:47.594389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 125/267] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 12:40:47.599984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2299b-bc15-4633-9be4-66ebd3547dee None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:47.716451 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2299b-bc15-4633-9be4-66ebd3547dee None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:47.763028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025763a-fdc0-4692-ba25-97a64e71e9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:47.763886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025763a-fdc0-4692-ba25-97a64e71e9b8 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:47.764165 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025763a-fdc0-4692-ba25-97a64e71e9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:47.764951 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025763a-fdc0-4692-ba25-97a64e71e9b8 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:47.767109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025763a-fdc0-4692-ba25-97a64e71e9b8 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:47.768955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025763a-fdc0-4692-ba25-97a64e71e9b8 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:47.771247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 143/268] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:47 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:47.778304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf31949-2d5a-497b-9e57-52bf19e18f94 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:47.880253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf31949-2d5a-497b-9e57-52bf19e18f94 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:47.914809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeb281-98bd-4505-96fc-343b5dc08699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:47.915472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeb281-98bd-4505-96fc-343b5dc08699 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:47.915763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeb281-98bd-4505-96fc-343b5dc08699 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:47.916013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeb281-98bd-4505-96fc-343b5dc08699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:47.916858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baeb281-98bd-4505-96fc-343b5dc08699 None admin] RBAC: Adding query filter params (role.id=82e7000d778e4c66a98f07a93e8ae084, scope.project.id=427007497a734b6ab72d65a07f3dcbb7, user.id=9f5d31c824424a04ac9f5c8975810ede) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:47.917219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baeb281-98bd-4505-96fc-343b5dc08699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:47.918743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baeb281-98bd-4505-96fc-343b5dc08699 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:47.926203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 126/269] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:47 2022] GET /identity/v3/role_assignments?user.id=9f5d31c824424a04ac9f5c8975810ede&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=82e7000d778e4c66a98f07a93e8ae084 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:48.095128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264d9f1-dafc-47d5-ae96-bc0644e9f668 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.095510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264d9f1-dafc-47d5-ae96-bc0644e9f668 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.095752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264d9f1-dafc-47d5-ae96-bc0644e9f668 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.097203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 144/270] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:48.103288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f48d60-2a9b-4cc0-b0b6-2b64d1981097 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.103600 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f48d60-2a9b-4cc0-b0b6-2b64d1981097 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.103846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f48d60-2a9b-4cc0-b0b6-2b64d1981097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.123034 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-81f48d60-2a9b-4cc0-b0b6-2b64d1981097 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:48.125163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-81f48d60-2a9b-4cc0-b0b6-2b64d1981097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:48.212783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 127/271] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:48.238617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264d9f1-dafc-47d5-ae96-bc0644e9f668 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:48.371973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264d9f1-dafc-47d5-ae96-bc0644e9f668 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:48.410214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb61f7-8572-4f4f-9003-f340dd23ae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:48.411101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb61f7-8572-4f4f-9003-f340dd23ae81 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.411431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb61f7-8572-4f4f-9003-f340dd23ae81 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.411758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb61f7-8572-4f4f-9003-f340dd23ae81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.423452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb61f7-8572-4f4f-9003-f340dd23ae81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:48.430874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-81eb61f7-8572-4f4f-9003-f340dd23ae81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:48.432270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 145/272] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:48.439070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f48d60-2a9b-4cc0-b0b6-2b64d1981097 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:48.519531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17c1a7-4f2d-4da5-8145-e8b6f51dfbda None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.519862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17c1a7-4f2d-4da5-8145-e8b6f51dfbda None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.520146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17c1a7-4f2d-4da5-8145-e8b6f51dfbda None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.521900 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 146/273] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:48.526992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e76fed-1f3d-4c93-8b12-a3b1c19fcb53 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.527279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e76fed-1f3d-4c93-8b12-a3b1c19fcb53 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.527557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e76fed-1f3d-4c93-8b12-a3b1c19fcb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.546085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b5e76fed-1f3d-4c93-8b12-a3b1c19fcb53 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:48.547361 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b5e76fed-1f3d-4c93-8b12-a3b1c19fcb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:48.549957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f48d60-2a9b-4cc0-b0b6-2b64d1981097 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:48.586773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67240bae-2132-4fb5-9a73-831f73a3baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:48.587451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67240bae-2132-4fb5-9a73-831f73a3baf4 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.587737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67240bae-2132-4fb5-9a73-831f73a3baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.588014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67240bae-2132-4fb5-9a73-831f73a3baf4 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.588838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67240bae-2132-4fb5-9a73-831f73a3baf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:48.589148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67240bae-2132-4fb5-9a73-831f73a3baf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:48.591181 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67240bae-2132-4fb5-9a73-831f73a3baf4 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:48.603013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 128/274] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:48.610072 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67240bae-2132-4fb5-9a73-831f73a3baf4 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:48.622745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 147/275] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:48.648595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e76fed-1f3d-4c93-8b12-a3b1c19fcb53 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:48.716428 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67240bae-2132-4fb5-9a73-831f73a3baf4 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:48.752662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e76fed-1f3d-4c93-8b12-a3b1c19fcb53 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:48.754999 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e8f44-e214-40ac-876f-b3146588d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:48.755874 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e8f44-e214-40ac-876f-b3146588d774 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.756161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e8f44-e214-40ac-876f-b3146588d774 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.756439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e8f44-e214-40ac-876f-b3146588d774 None admin] PATH_INFO: `/v3/users/88062aeaf181423ea466f389bb813038` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.770559 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e8f44-e214-40ac-876f-b3146588d774 None admin] RBAC: Authorizing `identity:get_user(user_id=88062aeaf181423ea466f389bb813038)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:48.772208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e8f44-e214-40ac-876f-b3146588d774 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:48.774194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 129/276] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:48 2022] GET /identity/v3/users/88062aeaf181423ea466f389bb813038 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:48.775191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14e92a-3452-4115-b73c-053efb106ecb None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.775479 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14e92a-3452-4115-b73c-053efb106ecb None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.775756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14e92a-3452-4115-b73c-053efb106ecb None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.781926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 130/277] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:48.782764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14e92a-3452-4115-b73c-053efb106ecb None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:48.794473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afd4b0-0ee3-41c0-a128-ba64f1329d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:48.795217 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd4b0-0ee3-41c0-a128-ba64f1329d8b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.795500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd4b0-0ee3-41c0-a128-ba64f1329d8b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.796338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afd4b0-0ee3-41c0-a128-ba64f1329d8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.797647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afd4b0-0ee3-41c0-a128-ba64f1329d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:48.799107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afd4b0-0ee3-41c0-a128-ba64f1329d8b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:48.800984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 148/278] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:48.803050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aaa34-7513-4f38-ad87-ab142c48b666 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.803341 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aaa34-7513-4f38-ad87-ab142c48b666 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.803622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64aaa34-7513-4f38-ad87-ab142c48b666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.820168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-c64aaa34-7513-4f38-ad87-ab142c48b666 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:48.821141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c64aaa34-7513-4f38-ad87-ab142c48b666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:48.887931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14e92a-3452-4115-b73c-053efb106ecb None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:48.888768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 149/279] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:48.889859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64aaa34-7513-4f38-ad87-ab142c48b666 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:48.934607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e48ea-8d12-4af6-8a93-4142bc02c914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:48.935364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e48ea-8d12-4af6-8a93-4142bc02c914 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:48.935656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e48ea-8d12-4af6-8a93-4142bc02c914 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:48.935933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e48ea-8d12-4af6-8a93-4142bc02c914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:48.937258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e48ea-8d12-4af6-8a93-4142bc02c914 None admin] RBAC: Adding query filter params (role.id=9b6d2d07e37f449699fd25de81ee509a, user.id=88062aeaf181423ea466f389bb813038, scope.system=all) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:48.937819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e48ea-8d12-4af6-8a93-4142bc02c914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:48.939463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e48ea-8d12-4af6-8a93-4142bc02c914 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:48.944807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 131/280] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Apr 6 12:40:48 2022] GET /identity/v3/role_assignments?user.id=88062aeaf181423ea466f389bb813038&scope.system=all&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:48.945518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e48ea-8d12-4af6-8a93-4142bc02c914 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:49.030610 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64aaa34-7513-4f38-ad87-ab142c48b666 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:49.064525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e48ea-8d12-4af6-8a93-4142bc02c914 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:49.078908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3afae3-b691-4020-8f8a-37c4cef500ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:49.080504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3afae3-b691-4020-8f8a-37c4cef500ba None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.080953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3afae3-b691-4020-8f8a-37c4cef500ba None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.081387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3afae3-b691-4020-8f8a-37c4cef500ba None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.082498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3afae3-b691-4020-8f8a-37c4cef500ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:49.084891 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3afae3-b691-4020-8f8a-37c4cef500ba None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:49.112445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11694-5ea1-439c-a8db-d61dec32af0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:49.113318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11694-5ea1-439c-a8db-d61dec32af0e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.113628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11694-5ea1-439c-a8db-d61dec32af0e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.113727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 150/281] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:40:48 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:49.113903 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11694-5ea1-439c-a8db-d61dec32af0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.115147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318e80-9980-4a92-bb89-21821b64af54 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.115441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318e80-9980-4a92-bb89-21821b64af54 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.115727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62318e80-9980-4a92-bb89-21821b64af54 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.117419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 151/282] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:49.122931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8cc48-5f49-47b4-9bd1-7ba6af1b9f2d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.123272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8cc48-5f49-47b4-9bd1-7ba6af1b9f2d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.123498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8cc48-5f49-47b4-9bd1-7ba6af1b9f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.128554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a11694-5ea1-439c-a8db-d61dec32af0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:49.136094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-c7a11694-5ea1-439c-a8db-d61dec32af0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 12:40:49.137513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 132/283] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:49.144749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11694-5ea1-439c-a8db-d61dec32af0e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:49.152999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-18e8cc48-5f49-47b4-9bd1-7ba6af1b9f2d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:49.154101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-18e8cc48-5f49-47b4-9bd1-7ba6af1b9f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:49.248523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 152/284] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:49.268773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8cc48-5f49-47b4-9bd1-7ba6af1b9f2d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:49.282982 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11694-5ea1-439c-a8db-d61dec32af0e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:49.319995 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3959e3-9547-44dc-8e7d-2da3c32ba825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:49.320665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3959e3-9547-44dc-8e7d-2da3c32ba825 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.320944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3959e3-9547-44dc-8e7d-2da3c32ba825 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.321221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3959e3-9547-44dc-8e7d-2da3c32ba825 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.322133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3959e3-9547-44dc-8e7d-2da3c32ba825 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:49.322443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3959e3-9547-44dc-8e7d-2da3c32ba825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:49.325075 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3959e3-9547-44dc-8e7d-2da3c32ba825 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:49.338062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 133/285] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:49.345847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3959e3-9547-44dc-8e7d-2da3c32ba825 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:49.396953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8cc48-5f49-47b4-9bd1-7ba6af1b9f2d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:49.434304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad868611-d33e-4a93-a930-908d7061e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:49.435501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad868611-d33e-4a93-a930-908d7061e1ba None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.435972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad868611-d33e-4a93-a930-908d7061e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.437088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad868611-d33e-4a93-a930-908d7061e1ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.449100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad868611-d33e-4a93-a930-908d7061e1ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:49.457322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-ad868611-d33e-4a93-a930-908d7061e1ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:49.458173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3959e3-9547-44dc-8e7d-2da3c32ba825 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:49.459382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 153/286] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:49.465136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad868611-d33e-4a93-a930-908d7061e1ba None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:49.495948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a44661-b2b1-463d-b0db-270cbdd13a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:49.496846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a44661-b2b1-463d-b0db-270cbdd13a01 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.497131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a44661-b2b1-463d-b0db-270cbdd13a01 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.497411 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a44661-b2b1-463d-b0db-270cbdd13a01 None admin] PATH_INFO: `/v3/users/e48bbd6bcdb846fca2222808caa015d6` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.498773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a44661-b2b1-463d-b0db-270cbdd13a01 None admin] RBAC: Authorizing `identity:get_user(user_id=e48bbd6bcdb846fca2222808caa015d6)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:49.500473 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a44661-b2b1-463d-b0db-270cbdd13a01 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:49.502471 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 134/287] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:49 2022] GET /identity/v3/users/e48bbd6bcdb846fca2222808caa015d6 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:49.507823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a44661-b2b1-463d-b0db-270cbdd13a01 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:49.594867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad868611-d33e-4a93-a930-908d7061e1ba None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:49.626924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a44661-b2b1-463d-b0db-270cbdd13a01 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:49.631368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c812e6-0671-4292-b3cd-ed1941b8542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:49.632043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c812e6-0671-4292-b3cd-ed1941b8542c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.632481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c812e6-0671-4292-b3cd-ed1941b8542c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.632819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c812e6-0671-4292-b3cd-ed1941b8542c None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.633595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c812e6-0671-4292-b3cd-ed1941b8542c None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:49.633938 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c812e6-0671-4292-b3cd-ed1941b8542c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:49.635360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c812e6-0671-4292-b3cd-ed1941b8542c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:49.644122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 154/288] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:49.649661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c812e6-0671-4292-b3cd-ed1941b8542c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:49.664320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3887-e346-41f3-bfa6-8ff320770d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:49.665194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3887-e346-41f3-bfa6-8ff320770d80 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.665480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3887-e346-41f3-bfa6-8ff320770d80 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.665797 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb3887-e346-41f3-bfa6-8ff320770d80 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.667002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3887-e346-41f3-bfa6-8ff320770d80 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:49.668476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb3887-e346-41f3-bfa6-8ff320770d80 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:49.670566 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 135/289] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:49 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:49.681491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3887-e346-41f3-bfa6-8ff320770d80 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:49.763881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c812e6-0671-4292-b3cd-ed1941b8542c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:49.802288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb3887-e346-41f3-bfa6-8ff320770d80 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:49.809000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2421980-188c-432a-ab95-86a8cefa5f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:49.810670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2421980-188c-432a-ab95-86a8cefa5f8e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.810956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2421980-188c-432a-ab95-86a8cefa5f8e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.815655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2421980-188c-432a-ab95-86a8cefa5f8e None admin] PATH_INFO: `/v3/users/525d9eecfa824ce192be4965cbeedb49` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.818235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2421980-188c-432a-ab95-86a8cefa5f8e None admin] RBAC: Authorizing `identity:get_user(user_id=525d9eecfa824ce192be4965cbeedb49)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:49.819692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2421980-188c-432a-ab95-86a8cefa5f8e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:49.823365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 155/290] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:49 2022] GET /identity/v3/users/525d9eecfa824ce192be4965cbeedb49 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:49.827036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2421980-188c-432a-ab95-86a8cefa5f8e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:49.867439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e46a-129c-4913-a7b2-8d21b348dfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:49.868260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e46a-129c-4913-a7b2-8d21b348dfb1 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:49.868546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e46a-129c-4913-a7b2-8d21b348dfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:49.868829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870e46a-129c-4913-a7b2-8d21b348dfb1 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7/users/e48bbd6bcdb846fca2222808caa015d6/roles/3f30dd1042dd434e99b85ce46f6e84cb` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:49.872947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870e46a-129c-4913-a7b2-8d21b348dfb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=427007497a734b6ab72d65a07f3dcbb7, user_id=e48bbd6bcdb846fca2222808caa015d6, role_id=3f30dd1042dd434e99b85ce46f6e84cb)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:49.875157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870e46a-129c-4913-a7b2-8d21b348dfb1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:49.898924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 136/291] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:40:49 2022] PUT /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7/users/e48bbd6bcdb846fca2222808caa015d6/roles/3f30dd1042dd434e99b85ce46f6e84cb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:49.984748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2421980-188c-432a-ab95-86a8cefa5f8e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:50.030396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffd6fb-a43f-49dd-b64c-0d5b7692cd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:50.031065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffd6fb-a43f-49dd-b64c-0d5b7692cd14 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:50.031351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffd6fb-a43f-49dd-b64c-0d5b7692cd14 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:50.031629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffd6fb-a43f-49dd-b64c-0d5b7692cd14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:50.115064 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffd6fb-a43f-49dd-b64c-0d5b7692cd14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:50.116572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffd6fb-a43f-49dd-b64c-0d5b7692cd14 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:50.245895 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 156/292] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:50.251316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e46a-129c-4913-a7b2-8d21b348dfb1 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:50.364457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870e46a-129c-4913-a7b2-8d21b348dfb1 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:50.406191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a633c3-fa23-4472-90b8-554bc1c9f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:50.407249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a633c3-fa23-4472-90b8-554bc1c9f50e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:50.407542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a633c3-fa23-4472-90b8-554bc1c9f50e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:50.407827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a633c3-fa23-4472-90b8-554bc1c9f50e None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:50.414622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a633c3-fa23-4472-90b8-554bc1c9f50e None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:50.416178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a633c3-fa23-4472-90b8-554bc1c9f50e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:50.418182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 137/293] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:50 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:50.425109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffd6fb-a43f-49dd-b64c-0d5b7692cd14 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:50.549362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffd6fb-a43f-49dd-b64c-0d5b7692cd14 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:50.591166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51704be-edba-4509-b229-ca08a3034b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:50.591824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51704be-edba-4509-b229-ca08a3034b5f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:50.592104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51704be-edba-4509-b229-ca08a3034b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:50.592376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51704be-edba-4509-b229-ca08a3034b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:50.593387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51704be-edba-4509-b229-ca08a3034b5f None admin] RBAC: Adding query filter params (role.id=9b6d2d07e37f449699fd25de81ee509a, scope.project.id=427007497a734b6ab72d65a07f3dcbb7, user.id=525d9eecfa824ce192be4965cbeedb49) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:50.593727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51704be-edba-4509-b229-ca08a3034b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:50.595185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51704be-edba-4509-b229-ca08a3034b5f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:50.605850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 157/294] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:50 2022] GET /identity/v3/role_assignments?user.id=525d9eecfa824ce192be4965cbeedb49&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:51.718651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35523eb5-33c5-4279-8011-949ff8691ecb None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:51.719146 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35523eb5-33c5-4279-8011-949ff8691ecb None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:51.719146 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35523eb5-33c5-4279-8011-949ff8691ecb None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:51.720783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 138/295] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:51.726516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c1068-b9a4-471c-b992-85300c3d6f1b None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:51.727442 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c1068-b9a4-471c-b992-85300c3d6f1b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:51.727964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c1068-b9a4-471c-b992-85300c3d6f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:51.745479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5e3c1068-b9a4-471c-b992-85300c3d6f1b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:51.747066 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5e3c1068-b9a4-471c-b992-85300c3d6f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:51.824623 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 158/296] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:51.839710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163baeb6-c786-4565-8945-7e1e3d80a193 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:51.840013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163baeb6-c786-4565-8945-7e1e3d80a193 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:51.840419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163baeb6-c786-4565-8945-7e1e3d80a193 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:51.842129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 139/297] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:51.851107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a83c1c-9354-4a33-b97a-eb0515255067 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:51.851643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a83c1c-9354-4a33-b97a-eb0515255067 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:51.852242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a83c1c-9354-4a33-b97a-eb0515255067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:51.853107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163baeb6-c786-4565-8945-7e1e3d80a193 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:51.871013 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-86a83c1c-9354-4a33-b97a-eb0515255067 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:51.872727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-86a83c1c-9354-4a33-b97a-eb0515255067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:51.961697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 159/298] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:51.967512 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163baeb6-c786-4565-8945-7e1e3d80a193 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:51.981379 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a83c1c-9354-4a33-b97a-eb0515255067 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:52.005994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135f3c-f6e5-410d-b187-e095d59bb829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:52.006894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135f3c-f6e5-410d-b187-e095d59bb829 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.007181 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135f3c-f6e5-410d-b187-e095d59bb829 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.007459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff135f3c-f6e5-410d-b187-e095d59bb829 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.020074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff135f3c-f6e5-410d-b187-e095d59bb829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:52.029434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-ff135f3c-f6e5-410d-b187-e095d59bb829 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:52.031117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 140/299] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:52.037005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135f3c-f6e5-410d-b187-e095d59bb829 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:52.091268 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a83c1c-9354-4a33-b97a-eb0515255067 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:52.127632 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87785-19b7-4efe-b2e2-32eb76fc08c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:52.128438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87785-19b7-4efe-b2e2-32eb76fc08c8 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.128721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87785-19b7-4efe-b2e2-32eb76fc08c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.129054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87785-19b7-4efe-b2e2-32eb76fc08c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.138198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff135f3c-f6e5-410d-b187-e095d59bb829 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:52.140449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af87785-19b7-4efe-b2e2-32eb76fc08c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:52.147983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-6af87785-19b7-4efe-b2e2-32eb76fc08c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 12:40:52.154434 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 160/300] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:52.155831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87785-19b7-4efe-b2e2-32eb76fc08c8 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:52.173014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb346f55-c3b7-4b47-a151-32768fb2ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:52.173823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346f55-c3b7-4b47-a151-32768fb2ff01 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.174116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346f55-c3b7-4b47-a151-32768fb2ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.174394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb346f55-c3b7-4b47-a151-32768fb2ff01 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.175150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb346f55-c3b7-4b47-a151-32768fb2ff01 None admin] RBAC: Adding query filter params (name=member) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:52.175707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb346f55-c3b7-4b47-a151-32768fb2ff01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:52.177116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb346f55-c3b7-4b47-a151-32768fb2ff01 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:52.185976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 141/301] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:52.194537 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb346f55-c3b7-4b47-a151-32768fb2ff01 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:52.267577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87785-19b7-4efe-b2e2-32eb76fc08c8 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:52.302420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aab88-8675-4f29-9778-0f7a7ce941ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:52.303104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aab88-8675-4f29-9778-0f7a7ce941ff None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.303390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aab88-8675-4f29-9778-0f7a7ce941ff None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.303668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aab88-8675-4f29-9778-0f7a7ce941ff None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.304437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aab88-8675-4f29-9778-0f7a7ce941ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:52.304747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aab88-8675-4f29-9778-0f7a7ce941ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:52.306219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aab88-8675-4f29-9778-0f7a7ce941ff None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:52.310062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb346f55-c3b7-4b47-a151-32768fb2ff01 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:52.320810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 161/302] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:52.320810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d9f9e-7b4d-4eec-a3fe-c2c580b53a5b None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.320810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d9f9e-7b4d-4eec-a3fe-c2c580b53a5b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.320810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d9f9e-7b4d-4eec-a3fe-c2c580b53a5b None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.320810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 162/303] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:52.321913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d9f9e-7b4d-4eec-a3fe-c2c580b53a5b None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:52.356061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2825727-b389-4813-b248-c3f84b87ea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:52.356934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2825727-b389-4813-b248-c3f84b87ea78 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.357217 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2825727-b389-4813-b248-c3f84b87ea78 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.357499 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2825727-b389-4813-b248-c3f84b87ea78 None admin] PATH_INFO: `/v3/users/88062aeaf181423ea466f389bb813038` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.359333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2825727-b389-4813-b248-c3f84b87ea78 None admin] RBAC: Authorizing `identity:get_user(user_id=88062aeaf181423ea466f389bb813038)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:52.360890 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2825727-b389-4813-b248-c3f84b87ea78 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:52.362556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 142/304] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:52 2022] GET /identity/v3/users/88062aeaf181423ea466f389bb813038 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:52.363711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56645-9472-4852-880f-37ccf9d4cfba None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.363993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56645-9472-4852-880f-37ccf9d4cfba None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.364263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56645-9472-4852-880f-37ccf9d4cfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.382470 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f6c56645-9472-4852-880f-37ccf9d4cfba None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:52.383664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f6c56645-9472-4852-880f-37ccf9d4cfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:52.447671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d9f9e-7b4d-4eec-a3fe-c2c580b53a5b None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:52.469768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 143/305] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:52.469768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c56645-9472-4852-880f-37ccf9d4cfba None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:52.495628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5a9eb-268a-45e1-8b32-d9eead0f38c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:52.496626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5a9eb-268a-45e1-8b32-d9eead0f38c0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.496950 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5a9eb-268a-45e1-8b32-d9eead0f38c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.497224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5a9eb-268a-45e1-8b32-d9eead0f38c0 None admin] PATH_INFO: `/v3/users/32784d33f20640d999db95b33d5ff620` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.510703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5a9eb-268a-45e1-8b32-d9eead0f38c0 None admin] RBAC: Authorizing `identity:get_user(user_id=32784d33f20640d999db95b33d5ff620)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:52.512230 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5a9eb-268a-45e1-8b32-d9eead0f38c0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:52.513952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 163/306] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:52 2022] GET /identity/v3/users/32784d33f20640d999db95b33d5ff620 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:52.514990 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5a9eb-268a-45e1-8b32-d9eead0f38c0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:52.567618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c56645-9472-4852-880f-37ccf9d4cfba None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:52.601404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e583bf1-f454-4b9a-9f87-3e07b771c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:52.602374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e583bf1-f454-4b9a-9f87-3e07b771c7aa None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.602684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e583bf1-f454-4b9a-9f87-3e07b771c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.602929 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e583bf1-f454-4b9a-9f87-3e07b771c7aa None admin] PATH_INFO: `/v3/system/users/88062aeaf181423ea466f389bb813038/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.604696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e583bf1-f454-4b9a-9f87-3e07b771c7aa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=88062aeaf181423ea466f389bb813038, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:52.606158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e583bf1-f454-4b9a-9f87-3e07b771c7aa None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:52.625603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 144/307] 10.222.0.23 () {58 vars in 1334 bytes} [Wed Apr 6 12:40:52 2022] PUT /identity/v3/system/users/88062aeaf181423ea466f389bb813038/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:52.625603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e583bf1-f454-4b9a-9f87-3e07b771c7aa None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:52.632953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5a9eb-268a-45e1-8b32-d9eead0f38c0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:52.687147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89b16c-6a1d-43b1-8d64-4de22eaa6a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:52.688296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89b16c-6a1d-43b1-8d64-4de22eaa6a18 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.688585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89b16c-6a1d-43b1-8d64-4de22eaa6a18 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.688865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89b16c-6a1d-43b1-8d64-4de22eaa6a18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.690800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89b16c-6a1d-43b1-8d64-4de22eaa6a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:52.692782 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89b16c-6a1d-43b1-8d64-4de22eaa6a18 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:52.694863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 164/308] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:52.696381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310171-b5c6-493a-8e6e-346c6897a68f None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.696708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310171-b5c6-493a-8e6e-346c6897a68f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.696986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310171-b5c6-493a-8e6e-346c6897a68f None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.698692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 165/309] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:52.702976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310171-b5c6-493a-8e6e-346c6897a68f None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:52.744066 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e583bf1-f454-4b9a-9f87-3e07b771c7aa None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:52.781893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aafe81-a78b-4ce2-a558-544740131b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:52.782541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aafe81-a78b-4ce2-a558-544740131b43 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.782828 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aafe81-a78b-4ce2-a558-544740131b43 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.783101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aafe81-a78b-4ce2-a558-544740131b43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.783939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aafe81-a78b-4ce2-a558-544740131b43 None admin] RBAC: Adding query filter params (role.id=3f30dd1042dd434e99b85ce46f6e84cb, user.id=32784d33f20640d999db95b33d5ff620, scope.system=all) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:52.784252 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aafe81-a78b-4ce2-a558-544740131b43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:52.785756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aafe81-a78b-4ce2-a558-544740131b43 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:52.791259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 145/310] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Apr 6 12:40:52 2022] GET /identity/v3/role_assignments?user.id=32784d33f20640d999db95b33d5ff620&scope.system=all&role.id=3f30dd1042dd434e99b85ce46f6e84cb => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:52.792575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423166be-64c7-481b-8294-76386ae575ae None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.792885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423166be-64c7-481b-8294-76386ae575ae None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.793166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423166be-64c7-481b-8294-76386ae575ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.811802 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-423166be-64c7-481b-8294-76386ae575ae None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:52.813074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-423166be-64c7-481b-8294-76386ae575ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:52.827283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310171-b5c6-493a-8e6e-346c6897a68f None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:52.875217 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e90fbe-380f-4ee7-bbbd-ba62e0ec1ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:52.876331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90fbe-380f-4ee7-bbbd-ba62e0ec1ce1 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:52.876612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90fbe-380f-4ee7-bbbd-ba62e0ec1ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:52.876895 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e90fbe-380f-4ee7-bbbd-ba62e0ec1ce1 None admin] PATH_INFO: `/v3/groups` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:52.877634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e90fbe-380f-4ee7-bbbd-ba62e0ec1ce1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:52.880147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e90fbe-380f-4ee7-bbbd-ba62e0ec1ce1 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:52.897038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 146/311] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:52.901157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 166/312] 10.222.0.23 () {60 vars in 1134 bytes} [Wed Apr 6 12:40:52 2022] POST /identity/v3/groups => generated 229 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:52.925857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423166be-64c7-481b-8294-76386ae575ae None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:53.040719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423166be-64c7-481b-8294-76386ae575ae None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:53.078626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d577c19-b907-4d9f-a8fe-ee11436b605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:53.079364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d577c19-b907-4d9f-a8fe-ee11436b605f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:53.079644 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d577c19-b907-4d9f-a8fe-ee11436b605f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:53.079921 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d577c19-b907-4d9f-a8fe-ee11436b605f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:53.091631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d577c19-b907-4d9f-a8fe-ee11436b605f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:53.099719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-1d577c19-b907-4d9f-a8fe-ee11436b605f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 12:40:53.101346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 147/313] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:53.107925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e90fbe-380f-4ee7-bbbd-ba62e0ec1ce1 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:53.224605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e90fbe-380f-4ee7-bbbd-ba62e0ec1ce1 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:53.262359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8e9c3-fc20-49fb-b956-77a624d4b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:53.263024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8e9c3-fc20-49fb-b956-77a624d4b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:53.263354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8e9c3-fc20-49fb-b956-77a624d4b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:53.263632 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8e9c3-fc20-49fb-b956-77a624d4b8c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:53.264923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8e9c3-fc20-49fb-b956-77a624d4b8c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:53.265229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8e9c3-fc20-49fb-b956-77a624d4b8c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:53.266647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8e9c3-fc20-49fb-b956-77a624d4b8c7 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:53.275270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 167/314] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:53.281080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d577c19-b907-4d9f-a8fe-ee11436b605f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:53.391224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d577c19-b907-4d9f-a8fe-ee11436b605f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:53.425185 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29e52-e7be-4032-ad11-38eadfb81247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:53.426744 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29e52-e7be-4032-ad11-38eadfb81247 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:53.427254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29e52-e7be-4032-ad11-38eadfb81247 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:53.427723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b29e52-e7be-4032-ad11-38eadfb81247 None admin] PATH_INFO: `/v3/users/e48bbd6bcdb846fca2222808caa015d6` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:53.429142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b29e52-e7be-4032-ad11-38eadfb81247 None admin] RBAC: Authorizing `identity:get_user(user_id=e48bbd6bcdb846fca2222808caa015d6)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:53.430868 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b29e52-e7be-4032-ad11-38eadfb81247 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:53.433080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 148/315] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:53 2022] GET /identity/v3/users/e48bbd6bcdb846fca2222808caa015d6 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:53.439396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8e9c3-fc20-49fb-b956-77a624d4b8c7 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:53.544775 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8e9c3-fc20-49fb-b956-77a624d4b8c7 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:53.578452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2195a5-35fe-4823-8732-5dff66998a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:53.579099 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2195a5-35fe-4823-8732-5dff66998a4e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:53.579377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2195a5-35fe-4823-8732-5dff66998a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:53.579650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2195a5-35fe-4823-8732-5dff66998a4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:53.646644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2195a5-35fe-4823-8732-5dff66998a4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:53.648031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2195a5-35fe-4823-8732-5dff66998a4e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:53.746310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 168/316] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:40:53.752869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29e52-e7be-4032-ad11-38eadfb81247 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:53.860017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b29e52-e7be-4032-ad11-38eadfb81247 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:53.896317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f832ed-0871-4e35-9bf4-12b7a21c8e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:53.897240 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f832ed-0871-4e35-9bf4-12b7a21c8e0e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:53.897467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f832ed-0871-4e35-9bf4-12b7a21c8e0e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:53.897773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f832ed-0871-4e35-9bf4-12b7a21c8e0e None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:53.898983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f832ed-0871-4e35-9bf4-12b7a21c8e0e None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:53.900474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f832ed-0871-4e35-9bf4-12b7a21c8e0e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:53.902570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 149/317] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:40:53 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:53.910693 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2195a5-35fe-4823-8732-5dff66998a4e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:54.013880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2195a5-35fe-4823-8732-5dff66998a4e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:54.048661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24631d47-f682-42b0-8bd9-2af0431e0e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:54.049313 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631d47-f682-42b0-8bd9-2af0431e0e61 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:54.049608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631d47-f682-42b0-8bd9-2af0431e0e61 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:54.049881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631d47-f682-42b0-8bd9-2af0431e0e61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:54.050964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631d47-f682-42b0-8bd9-2af0431e0e61 None admin] RBAC: Adding query filter params (role.id=3f30dd1042dd434e99b85ce46f6e84cb, scope.project.id=427007497a734b6ab72d65a07f3dcbb7, user.id=e48bbd6bcdb846fca2222808caa015d6) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:54.051268 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631d47-f682-42b0-8bd9-2af0431e0e61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:54.052711 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631d47-f682-42b0-8bd9-2af0431e0e61 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:54.059014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 169/318] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:40:53 2022] GET /identity/v3/role_assignments?user.id=e48bbd6bcdb846fca2222808caa015d6&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=3f30dd1042dd434e99b85ce46f6e84cb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:55.119373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7fc05-99c0-4848-a08c-56071a578acf None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.119896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7fc05-99c0-4848-a08c-56071a578acf None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.119972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7fc05-99c0-4848-a08c-56071a578acf None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.121282 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 150/319] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:55.126973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443bc32-b2a8-4574-ae35-9deeebfefae9 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.127400 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443bc32-b2a8-4574-ae35-9deeebfefae9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.127518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443bc32-b2a8-4574-ae35-9deeebfefae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.134809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae48e0c-b7db-4dfc-be09-e7cf494d4ebf None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.135308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae48e0c-b7db-4dfc-be09-e7cf494d4ebf None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.135728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae48e0c-b7db-4dfc-be09-e7cf494d4ebf None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.137204 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 151/320] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:40:55.143346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17710-c9ad-4b3b-aeb5-c8fa1811f71b None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.143806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17710-c9ad-4b3b-aeb5-c8fa1811f71b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.144242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17710-c9ad-4b3b-aeb5-c8fa1811f71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.145144 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-f443bc32-b2a8-4574-ae35-9deeebfefae9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:55.146367 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f443bc32-b2a8-4574-ae35-9deeebfefae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:55.162296 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-37a17710-c9ad-4b3b-aeb5-c8fa1811f71b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:55.163880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-37a17710-c9ad-4b3b-aeb5-c8fa1811f71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:55.213138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 170/321] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:55.230690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 152/322] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:55.240995 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443bc32-b2a8-4574-ae35-9deeebfefae9 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:55.253466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a17710-c9ad-4b3b-aeb5-c8fa1811f71b None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:55.342195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443bc32-b2a8-4574-ae35-9deeebfefae9 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:55.367055 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a17710-c9ad-4b3b-aeb5-c8fa1811f71b None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:55.384545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54a859-f204-475b-ab10-37016ec134aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:55.384545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a859-f204-475b-ab10-37016ec134aa None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.385061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a859-f204-475b-ab10-37016ec134aa None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.385061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54a859-f204-475b-ab10-37016ec134aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.397361 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54a859-f204-475b-ab10-37016ec134aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:55.403204 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd626c34-0e40-4225-9987-e98842dfd05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:55.403992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd626c34-0e40-4225-9987-e98842dfd05f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.404273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd626c34-0e40-4225-9987-e98842dfd05f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.404379 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-3d54a859-f204-475b-ab10-37016ec134aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:55.404546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd626c34-0e40-4225-9987-e98842dfd05f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.406704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 171/323] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:40:55.407978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7acc3-8fa0-4d28-b042-b4d64a4dc742 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.408252 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7acc3-8fa0-4d28-b042-b4d64a4dc742 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.408527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7acc3-8fa0-4d28-b042-b4d64a4dc742 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.409816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 172/324] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:55.412425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7acc3-8fa0-4d28-b042-b4d64a4dc742 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:55.421657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd626c34-0e40-4225-9987-e98842dfd05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:55.429415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-dd626c34-0e40-4225-9987-e98842dfd05f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 12:40:55.430656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 153/325] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:40:55.433044 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542a8f3-96ff-41d1-b649-9d1e928ab93c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.433340 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542a8f3-96ff-41d1-b649-9d1e928ab93c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.433670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542a8f3-96ff-41d1-b649-9d1e928ab93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.451404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b542a8f3-96ff-41d1-b649-9d1e928ab93c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:55.453398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b542a8f3-96ff-41d1-b649-9d1e928ab93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:55.511405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7acc3-8fa0-4d28-b042-b4d64a4dc742 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:55.515726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 154/326] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:55.516563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542a8f3-96ff-41d1-b649-9d1e928ab93c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:55.547834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472e3fa-ad0f-4ff5-a443-06f25341de59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:55.548536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472e3fa-ad0f-4ff5-a443-06f25341de59 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.548857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472e3fa-ad0f-4ff5-a443-06f25341de59 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.549138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472e3fa-ad0f-4ff5-a443-06f25341de59 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.550018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472e3fa-ad0f-4ff5-a443-06f25341de59 None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:55.550272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472e3fa-ad0f-4ff5-a443-06f25341de59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:55.551991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472e3fa-ad0f-4ff5-a443-06f25341de59 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:55.559947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 173/327] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:55.560779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472e3fa-ad0f-4ff5-a443-06f25341de59 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:55.615246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542a8f3-96ff-41d1-b649-9d1e928ab93c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:55.650734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da844f01-d225-4078-bdd2-87062049968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:55.651341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da844f01-d225-4078-bdd2-87062049968b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.651625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da844f01-d225-4078-bdd2-87062049968b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.651901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da844f01-d225-4078-bdd2-87062049968b None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.652653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da844f01-d225-4078-bdd2-87062049968b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:55.652962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da844f01-d225-4078-bdd2-87062049968b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:55.654568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da844f01-d225-4078-bdd2-87062049968b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:55.663517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 155/328] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:55.664332 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da844f01-d225-4078-bdd2-87062049968b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:55.668517 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472e3fa-ad0f-4ff5-a443-06f25341de59 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:55.700800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2add5-f272-42e6-a73b-829650a3bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:55.701720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2add5-f272-42e6-a73b-829650a3bd8d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.702793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2add5-f272-42e6-a73b-829650a3bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.702793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2add5-f272-42e6-a73b-829650a3bd8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.703811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2add5-f272-42e6-a73b-829650a3bd8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:55.705249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2add5-f272-42e6-a73b-829650a3bd8d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:55.706861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 174/329] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:40:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:55.707608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2add5-f272-42e6-a73b-829650a3bd8d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:55.762930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da844f01-d225-4078-bdd2-87062049968b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:55.795458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29de7ea-0f2d-4772-8508-c954e19ecef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:55.796311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29de7ea-0f2d-4772-8508-c954e19ecef0 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.796628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29de7ea-0f2d-4772-8508-c954e19ecef0 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.796899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29de7ea-0f2d-4772-8508-c954e19ecef0 None admin] PATH_INFO: `/v3/users/88062aeaf181423ea466f389bb813038` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.798105 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29de7ea-0f2d-4772-8508-c954e19ecef0 None admin] RBAC: Authorizing `identity:get_user(user_id=88062aeaf181423ea466f389bb813038)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:55.799580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29de7ea-0f2d-4772-8508-c954e19ecef0 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:55.801443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 156/330] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:55 2022] GET /identity/v3/users/88062aeaf181423ea466f389bb813038 => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:55.802205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29de7ea-0f2d-4772-8508-c954e19ecef0 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:55.808198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2add5-f272-42e6-a73b-829650a3bd8d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:55.842335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19105e-ec6c-4136-b707-d6cfc122486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:55.843269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19105e-ec6c-4136-b707-d6cfc122486f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.843596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19105e-ec6c-4136-b707-d6cfc122486f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.843868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19105e-ec6c-4136-b707-d6cfc122486f None admin] PATH_INFO: `/v3/users/32784d33f20640d999db95b33d5ff620` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.845050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19105e-ec6c-4136-b707-d6cfc122486f None admin] RBAC: Authorizing `identity:get_user(user_id=32784d33f20640d999db95b33d5ff620)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:55.846678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19105e-ec6c-4136-b707-d6cfc122486f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:55.848339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 175/331] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:55 2022] GET /identity/v3/users/32784d33f20640d999db95b33d5ff620 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:55.849134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19105e-ec6c-4136-b707-d6cfc122486f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:55.898959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29de7ea-0f2d-4772-8508-c954e19ecef0 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:55.931432 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84a86c-ad55-412b-a7d6-4e297ea19f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:55.932019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84a86c-ad55-412b-a7d6-4e297ea19f83 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.932298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84a86c-ad55-412b-a7d6-4e297ea19f83 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.932571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84a86c-ad55-412b-a7d6-4e297ea19f83 None admin] PATH_INFO: `/v3/groups` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.933260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84a86c-ad55-412b-a7d6-4e297ea19f83 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:55.934764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84a86c-ad55-412b-a7d6-4e297ea19f83 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:55.946698 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19105e-ec6c-4136-b707-d6cfc122486f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:55.950292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 157/332] 10.222.0.23 () {60 vars in 1134 bytes} [Wed Apr 6 12:40:55 2022] POST /identity/v3/groups => generated 226 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:40:55.954784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84a86c-ad55-412b-a7d6-4e297ea19f83 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:55.984675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796b3cc-91f0-4538-8683-1f1170a6a52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:55.985349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b3cc-91f0-4538-8683-1f1170a6a52c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:55.985681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b3cc-91f0-4538-8683-1f1170a6a52c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:55.985935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b3cc-91f0-4538-8683-1f1170a6a52c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:55.986781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796b3cc-91f0-4538-8683-1f1170a6a52c None admin] RBAC: Adding query filter params (role.id=9b6d2d07e37f449699fd25de81ee509a, user.id=88062aeaf181423ea466f389bb813038, scope.system=all) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:55.987092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796b3cc-91f0-4538-8683-1f1170a6a52c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:55.988573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796b3cc-91f0-4538-8683-1f1170a6a52c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:56.002151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 176/333] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Apr 6 12:40:55 2022] GET /identity/v3/role_assignments?user.id=88062aeaf181423ea466f389bb813038&scope.system=all&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 510 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:56.075492 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84a86c-ad55-412b-a7d6-4e297ea19f83 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:56.114592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac8bee-a2df-4850-aa36-e8d286c176d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:56.115946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac8bee-a2df-4850-aa36-e8d286c176d1 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:56.116463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac8bee-a2df-4850-aa36-e8d286c176d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:56.116952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac8bee-a2df-4850-aa36-e8d286c176d1 None admin] PATH_INFO: `/v3/system/users/32784d33f20640d999db95b33d5ff620/roles/3f30dd1042dd434e99b85ce46f6e84cb` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:56.118948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac8bee-a2df-4850-aa36-e8d286c176d1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=32784d33f20640d999db95b33d5ff620, role_id=3f30dd1042dd434e99b85ce46f6e84cb)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:56.120729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac8bee-a2df-4850-aa36-e8d286c176d1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:56.129909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 158/334] 10.222.0.23 () {58 vars in 1334 bytes} [Wed Apr 6 12:40:55 2022] PUT /identity/v3/system/users/32784d33f20640d999db95b33d5ff620/roles/3f30dd1042dd434e99b85ce46f6e84cb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:40:59.013179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4286fe8-4680-4021-bdb7-b2c621261bdd None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.013715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4286fe8-4680-4021-bdb7-b2c621261bdd None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.013822 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4286fe8-4680-4021-bdb7-b2c621261bdd None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.016137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 177/335] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:59.024036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157ff7a-2056-471c-a0f7-531a7c7caaf7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.024968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157ff7a-2056-471c-a0f7-531a7c7caaf7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.025442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157ff7a-2056-471c-a0f7-531a7c7caaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.048689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3157ff7a-2056-471c-a0f7-531a7c7caaf7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:59.050801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3157ff7a-2056-471c-a0f7-531a7c7caaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:59.150016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 159/336] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:59.150882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc6812-5e60-4b09-9cb5-a297456ff0ba None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.151178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc6812-5e60-4b09-9cb5-a297456ff0ba None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.151458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc6812-5e60-4b09-9cb5-a297456ff0ba None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.153053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 178/337] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:59.159868 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520a37-40b2-414b-aeef-b0d42e54f1b7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.160439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520a37-40b2-414b-aeef-b0d42e54f1b7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.160919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a520a37-40b2-414b-aeef-b0d42e54f1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.187456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-8a520a37-40b2-414b-aeef-b0d42e54f1b7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:59.188728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8a520a37-40b2-414b-aeef-b0d42e54f1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:59.189459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc6812-5e60-4b09-9cb5-a297456ff0ba None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:59.282856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 160/338] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:40:59.322706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520a37-40b2-414b-aeef-b0d42e54f1b7 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:59.336813 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc6812-5e60-4b09-9cb5-a297456ff0ba None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:59.391236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3733c7-15cb-4e0b-8f13-aa05815c3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:59.392042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3733c7-15cb-4e0b-8f13-aa05815c3aef None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.392327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3733c7-15cb-4e0b-8f13-aa05815c3aef None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.392600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3733c7-15cb-4e0b-8f13-aa05815c3aef None admin] PATH_INFO: `/v3/roles/member` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.410830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3733c7-15cb-4e0b-8f13-aa05815c3aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:59.426025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-7c3733c7-15cb-4e0b-8f13-aa05815c3aef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:40:59.427674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 179/339] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:40:59.442636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3733c7-15cb-4e0b-8f13-aa05815c3aef None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:59.463078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a520a37-40b2-414b-aeef-b0d42e54f1b7 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:59.511863 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5b0d4-cdf6-4e58-bdd0-fd7bf18bc777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:59.512680 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5b0d4-cdf6-4e58-bdd0-fd7bf18bc777 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.512961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5b0d4-cdf6-4e58-bdd0-fd7bf18bc777 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.513233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5b0d4-cdf6-4e58-bdd0-fd7bf18bc777 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.531374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5b0d4-cdf6-4e58-bdd0-fd7bf18bc777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:40:59.542881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-2cc5b0d4-cdf6-4e58-bdd0-fd7bf18bc777 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 06 12:40:59.544084 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 161/340] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:40:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:40:59.550120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5b0d4-cdf6-4e58-bdd0-fd7bf18bc777 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:59.609836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3733c7-15cb-4e0b-8f13-aa05815c3aef None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:59.667651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5b0d4-cdf6-4e58-bdd0-fd7bf18bc777 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:59.687454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dada0f9-c4d1-4f79-8456-7054e972f72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:59.688139 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada0f9-c4d1-4f79-8456-7054e972f72f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.688427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada0f9-c4d1-4f79-8456-7054e972f72f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.688706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dada0f9-c4d1-4f79-8456-7054e972f72f None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.689467 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dada0f9-c4d1-4f79-8456-7054e972f72f None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:59.693872 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dada0f9-c4d1-4f79-8456-7054e972f72f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:59.695293 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dada0f9-c4d1-4f79-8456-7054e972f72f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:59.709755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 180/341] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:40:59.711274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013c433-9039-416d-8387-95e51b1437a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:59.711947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c433-9039-416d-8387-95e51b1437a4 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.712231 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c433-9039-416d-8387-95e51b1437a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.712504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013c433-9039-416d-8387-95e51b1437a4 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.713265 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013c433-9039-416d-8387-95e51b1437a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:40:59.713593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013c433-9039-416d-8387-95e51b1437a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:40:59.715021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013c433-9039-416d-8387-95e51b1437a4 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:40:59.716761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed01f-65a9-4fcd-8fc5-a940f8bb348b None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.717095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed01f-65a9-4fcd-8fc5-a940f8bb348b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.717545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed01f-65a9-4fcd-8fc5-a940f8bb348b None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.719090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 181/342] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:40:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:40:59.719840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ed01f-65a9-4fcd-8fc5-a940f8bb348b None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:59.740195 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 162/343] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:40:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:40:59.743463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9951f47-e895-4e9b-a209-817254c3b634 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.743756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9951f47-e895-4e9b-a209-817254c3b634 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.744031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9951f47-e895-4e9b-a209-817254c3b634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.767901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c9951f47-e895-4e9b-a209-817254c3b634 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:40:59.769119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c9951f47-e895-4e9b-a209-817254c3b634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:40:59.844619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 163/344] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:40:59.845754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9951f47-e895-4e9b-a209-817254c3b634 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:40:59.891368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ed01f-65a9-4fcd-8fc5-a940f8bb348b None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:40:59.931943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc5f94-46d1-48a7-b933-e8e14f3ef0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:40:59.932671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5f94-46d1-48a7-b933-e8e14f3ef0e8 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:40:59.933097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5f94-46d1-48a7-b933-e8e14f3ef0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:40:59.933452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc5f94-46d1-48a7-b933-e8e14f3ef0e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:40:59.954839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9951f47-e895-4e9b-a209-817254c3b634 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:00.006710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc5f94-46d1-48a7-b933-e8e14f3ef0e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:00.008147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc5f94-46d1-48a7-b933-e8e14f3ef0e8 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:00.114368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655900e-35df-43e1-8561-d601b299a6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:00.115815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655900e-35df-43e1-8561-d601b299a6e1 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.116304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655900e-35df-43e1-8561-d601b299a6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.116771 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655900e-35df-43e1-8561-d601b299a6e1 None admin] PATH_INFO: `/v3/users/32784d33f20640d999db95b33d5ff620` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.118298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655900e-35df-43e1-8561-d601b299a6e1 None admin] RBAC: Authorizing `identity:get_user(user_id=32784d33f20640d999db95b33d5ff620)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:00.119504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 182/345] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:00.120542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655900e-35df-43e1-8561-d601b299a6e1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:00.121046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37355e-c5af-4d3f-b80a-b3ca1c60b32a None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.121335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37355e-c5af-4d3f-b80a-b3ca1c60b32a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.121625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37355e-c5af-4d3f-b80a-b3ca1c60b32a None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.123346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 164/347] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:40:59 2022] GET /identity/v3/users/32784d33f20640d999db95b33d5ff620 => generated 293 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:00.124328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655900e-35df-43e1-8561-d601b299a6e1 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:00.127587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 183/347] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:00.129038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37355e-c5af-4d3f-b80a-b3ca1c60b32a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:00.231438 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655900e-35df-43e1-8561-d601b299a6e1 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:00.237135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37355e-c5af-4d3f-b80a-b3ca1c60b32a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:00.275963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241e73e-edda-402a-9d05-e09facc2b9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:00.276763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241e73e-edda-402a-9d05-e09facc2b9a0 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.277050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241e73e-edda-402a-9d05-e09facc2b9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.277326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241e73e-edda-402a-9d05-e09facc2b9a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.278878 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2676-974f-468f-bc2c-eeaa9e5c7029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:00.279904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2676-974f-468f-bc2c-eeaa9e5c7029 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.280180 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2676-974f-468f-bc2c-eeaa9e5c7029 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.280715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e2676-974f-468f-bc2c-eeaa9e5c7029 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.282340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e2676-974f-468f-bc2c-eeaa9e5c7029 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:00.283898 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e2676-974f-468f-bc2c-eeaa9e5c7029 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:00.285491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 184/348] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:00 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:00.286419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2676-974f-468f-bc2c-eeaa9e5c7029 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:00.290936 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241e73e-edda-402a-9d05-e09facc2b9a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:00.299274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-e241e73e-edda-402a-9d05-e09facc2b9a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:41:00.301069 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 165/349] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:00.302563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa642bb-3250-48b1-947f-128b76cf4460 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.303047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa642bb-3250-48b1-947f-128b76cf4460 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.303509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa642bb-3250-48b1-947f-128b76cf4460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.324580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3aa642bb-3250-48b1-947f-128b76cf4460 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:00.325812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3aa642bb-3250-48b1-947f-128b76cf4460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:00.418107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 166/350] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:00.419403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2a2f-62b7-4bac-ad99-f5cdec3a4bc8 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.419688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2a2f-62b7-4bac-ad99-f5cdec3a4bc8 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.419963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2a2f-62b7-4bac-ad99-f5cdec3a4bc8 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.422518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 167/351] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:00.422784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2a2f-62b7-4bac-ad99-f5cdec3a4bc8 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:00.429134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e2676-974f-468f-bc2c-eeaa9e5c7029 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:00.474376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68c2d-bdfc-4066-aac1-6849ea2fa859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:00.475088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68c2d-bdfc-4066-aac1-6849ea2fa859 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.475774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68c2d-bdfc-4066-aac1-6849ea2fa859 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.476152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68c2d-bdfc-4066-aac1-6849ea2fa859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.477234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d68c2d-bdfc-4066-aac1-6849ea2fa859 None admin] RBAC: Adding query filter params (role.id=3f30dd1042dd434e99b85ce46f6e84cb, user.id=32784d33f20640d999db95b33d5ff620, scope.system=all) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:00.477868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d68c2d-bdfc-4066-aac1-6849ea2fa859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:00.479321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d68c2d-bdfc-4066-aac1-6849ea2fa859 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:00.497202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 185/352] 10.222.0.23 () {56 vars in 1308 bytes} [Wed Apr 6 12:41:00 2022] GET /identity/v3/role_assignments?user.id=32784d33f20640d999db95b33d5ff620&scope.system=all&role.id=3f30dd1042dd434e99b85ce46f6e84cb => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:00.497904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68c2d-bdfc-4066-aac1-6849ea2fa859 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:00.558987 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2a2f-62b7-4bac-ad99-f5cdec3a4bc8 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:00.600238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24150e1-615d-430c-ba1f-005d1891d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:00.601336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24150e1-615d-430c-ba1f-005d1891d598 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.601466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24150e1-615d-430c-ba1f-005d1891d598 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.604051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24150e1-615d-430c-ba1f-005d1891d598 None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.612198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24150e1-615d-430c-ba1f-005d1891d598 None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:00.613784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24150e1-615d-430c-ba1f-005d1891d598 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:00.615933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 168/353] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:00 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:00.617236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e7198-9cd1-431a-8ec6-effdb71840d7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.617601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e7198-9cd1-431a-8ec6-effdb71840d7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.622246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e7198-9cd1-431a-8ec6-effdb71840d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.641697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-468e7198-9cd1-431a-8ec6-effdb71840d7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:00.642918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-468e7198-9cd1-431a-8ec6-effdb71840d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:00.644432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68c2d-bdfc-4066-aac1-6849ea2fa859 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:00.681074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f8fb2-ec7f-4d1b-bbbe-c8f2ae393e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:00.682145 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8fb2-ec7f-4d1b-bbbe-c8f2ae393e44 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.682624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8fb2-ec7f-4d1b-bbbe-c8f2ae393e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.683110 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f8fb2-ec7f-4d1b-bbbe-c8f2ae393e44 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.684052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f8fb2-ec7f-4d1b-bbbe-c8f2ae393e44 None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:00.684549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f8fb2-ec7f-4d1b-bbbe-c8f2ae393e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:00.686816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f8fb2-ec7f-4d1b-bbbe-c8f2ae393e44 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:00.696364 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 186/354] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:41:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:00.697599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f8fb2-ec7f-4d1b-bbbe-c8f2ae393e44 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:00.719669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 169/355] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:00.720695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e7198-9cd1-431a-8ec6-effdb71840d7 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:00.810469 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f8fb2-ec7f-4d1b-bbbe-c8f2ae393e44 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:00.843397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e7198-9cd1-431a-8ec6-effdb71840d7 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:00.853283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c460b-0872-4f24-adac-db5691ca11fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:00.853670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c460b-0872-4f24-adac-db5691ca11fc None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.853896 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c460b-0872-4f24-adac-db5691ca11fc None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.854169 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c460b-0872-4f24-adac-db5691ca11fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.870297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c460b-0872-4f24-adac-db5691ca11fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:00.880401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-db7c460b-0872-4f24-adac-db5691ca11fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:41:00.882350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 187/356] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:41:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:00.883486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c460b-0872-4f24-adac-db5691ca11fc None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:00.887741 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc810a-dc52-4da6-859b-8557f7fb2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:00.888385 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc810a-dc52-4da6-859b-8557f7fb2e91 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:00.888779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc810a-dc52-4da6-859b-8557f7fb2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:00.889156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc810a-dc52-4da6-859b-8557f7fb2e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:00.890258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc810a-dc52-4da6-859b-8557f7fb2e91 None admin] RBAC: Adding query filter params (group.id=2d6fbab3cb394bddbf30de888599eff7, role.id=9b6d2d07e37f449699fd25de81ee509a, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:00.890646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc810a-dc52-4da6-859b-8557f7fb2e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:00.892200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc810a-dc52-4da6-859b-8557f7fb2e91 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:00.905776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 170/357] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Apr 6 12:41:00 2022] GET /identity/v3/role_assignments?group.id=2d6fbab3cb394bddbf30de888599eff7&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:00.906868 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc810a-dc52-4da6-859b-8557f7fb2e91 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:01.008916 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c460b-0872-4f24-adac-db5691ca11fc None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:01.044575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc810a-dc52-4da6-859b-8557f7fb2e91 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:01.046944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2966a72-23d7-4917-a600-9f4a3c109c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:01.047614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966a72-23d7-4917-a600-9f4a3c109c30 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:01.048794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966a72-23d7-4917-a600-9f4a3c109c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:01.048794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966a72-23d7-4917-a600-9f4a3c109c30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:01.086524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c7be0-160f-4967-8be9-fdc05926b97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:01.088108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c7be0-160f-4967-8be9-fdc05926b97a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:01.088594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c7be0-160f-4967-8be9-fdc05926b97a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:01.089068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c7be0-160f-4967-8be9-fdc05926b97a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:01.103633 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c7be0-160f-4967-8be9-fdc05926b97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:01.111497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-339c7be0-160f-4967-8be9-fdc05926b97a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:41:01.112738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 171/358] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:41:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:01.113672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c7be0-160f-4967-8be9-fdc05926b97a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:01.133962 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966a72-23d7-4917-a600-9f4a3c109c30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:01.135478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2966a72-23d7-4917-a600-9f4a3c109c30 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:01.216204 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c7be0-160f-4967-8be9-fdc05926b97a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:01.256596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356fa2b-6cca-460e-8d72-53bad79c726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:01.257587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356fa2b-6cca-460e-8d72-53bad79c726b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:01.257875 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356fa2b-6cca-460e-8d72-53bad79c726b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:01.258153 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356fa2b-6cca-460e-8d72-53bad79c726b None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:01.258904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356fa2b-6cca-460e-8d72-53bad79c726b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:01.259265 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356fa2b-6cca-460e-8d72-53bad79c726b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:01.260674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 188/359] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:01.261480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356fa2b-6cca-460e-8d72-53bad79c726b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:01.266475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577049-b435-4f30-bdbe-9751a6be3f8a None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:01.266757 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577049-b435-4f30-bdbe-9751a6be3f8a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:01.267032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577049-b435-4f30-bdbe-9751a6be3f8a None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:01.268394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 189/360] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:01.269107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60577049-b435-4f30-bdbe-9751a6be3f8a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:01.271099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 172/361] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:01.271966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356fa2b-6cca-460e-8d72-53bad79c726b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:01.391990 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60577049-b435-4f30-bdbe-9751a6be3f8a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:01.393023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356fa2b-6cca-460e-8d72-53bad79c726b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:01.431737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6937a5b-caec-4d64-9925-5f2f90bc396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:01.432661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937a5b-caec-4d64-9925-5f2f90bc396c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:01.432940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937a5b-caec-4d64-9925-5f2f90bc396c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:01.433213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937a5b-caec-4d64-9925-5f2f90bc396c None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:01.434451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6937a5b-caec-4d64-9925-5f2f90bc396c None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:01.436510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6937a5b-caec-4d64-9925-5f2f90bc396c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:01.438247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 173/362] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:01 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:01.438979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82d87e-81cf-4117-b38f-43d987801ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:01.439421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55279-21b8-402d-8dc5-e14a5640b3cc None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:01.439699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55279-21b8-402d-8dc5-e14a5640b3cc None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:01.439969 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55279-21b8-402d-8dc5-e14a5640b3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:01.440524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d87e-81cf-4117-b38f-43d987801ccb None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:01.441004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d87e-81cf-4117-b38f-43d987801ccb None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:01.441523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82d87e-81cf-4117-b38f-43d987801ccb None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:01.442647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d87e-81cf-4117-b38f-43d987801ccb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:01.443151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d87e-81cf-4117-b38f-43d987801ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:01.444869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82d87e-81cf-4117-b38f-43d987801ccb None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:01.454733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 190/363] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:01.455957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82d87e-81cf-4117-b38f-43d987801ccb None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:01.457124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-8eb55279-21b8-402d-8dc5-e14a5640b3cc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:01.458335 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8eb55279-21b8-402d-8dc5-e14a5640b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:01.542105 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 174/364] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:01.543077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55279-21b8-402d-8dc5-e14a5640b3cc None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:01.600591 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82d87e-81cf-4117-b38f-43d987801ccb None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:01.648903 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d2ad-0210-44ca-80d6-becbd5d9dc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:01.649972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d2ad-0210-44ca-80d6-becbd5d9dc22 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:01.650109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d2ad-0210-44ca-80d6-becbd5d9dc22 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:01.650374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56d2ad-0210-44ca-80d6-becbd5d9dc22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:01.672227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55279-21b8-402d-8dc5-e14a5640b3cc None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:01.715320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e3187-1250-44fd-83d0-d3573cd4812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:01.716440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3187-1250-44fd-83d0-d3573cd4812c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:01.716868 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3187-1250-44fd-83d0-d3573cd4812c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:01.718005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3187-1250-44fd-83d0-d3573cd4812c None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:01.719376 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e3187-1250-44fd-83d0-d3573cd4812c None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:01.721258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e3187-1250-44fd-83d0-d3573cd4812c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:01.723105 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 175/365] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:01 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:01.723519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e3187-1250-44fd-83d0-d3573cd4812c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:01.741445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56d2ad-0210-44ca-80d6-becbd5d9dc22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:01.743181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56d2ad-0210-44ca-80d6-becbd5d9dc22 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:01.863289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e3187-1250-44fd-83d0-d3573cd4812c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:01.878581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 191/366] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:01.879686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d2ad-0210-44ca-80d6-becbd5d9dc22 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:01.908200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5bb49-8981-4fb6-9b67-c9e232fb936f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:01.908902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5bb49-8981-4fb6-9b67-c9e232fb936f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:01.909126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5bb49-8981-4fb6-9b67-c9e232fb936f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:01.909418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5bb49-8981-4fb6-9b67-c9e232fb936f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:01.990883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5bb49-8981-4fb6-9b67-c9e232fb936f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:01.990883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5bb49-8981-4fb6-9b67-c9e232fb936f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:02.011443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56d2ad-0210-44ca-80d6-becbd5d9dc22 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:02.055454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312d183-b80f-4a8c-8c0f-4f3bacb4ebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:02.056734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312d183-b80f-4a8c-8c0f-4f3bacb4ebb4 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:02.057030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312d183-b80f-4a8c-8c0f-4f3bacb4ebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:02.057351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312d183-b80f-4a8c-8c0f-4f3bacb4ebb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:02.072103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312d183-b80f-4a8c-8c0f-4f3bacb4ebb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:02.079719 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-9312d183-b80f-4a8c-8c0f-4f3bacb4ebb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:41:02.081725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 192/367] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:02.082833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312d183-b80f-4a8c-8c0f-4f3bacb4ebb4 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:02.103273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 176/368] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:02.104475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5bb49-8981-4fb6-9b67-c9e232fb936f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:02.195843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312d183-b80f-4a8c-8c0f-4f3bacb4ebb4 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:02.206935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5bb49-8981-4fb6-9b67-c9e232fb936f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:02.245296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d814e-7eee-4a17-ae13-85a707ff0d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:02.245987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d814e-7eee-4a17-ae13-85a707ff0d8b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:02.246271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d814e-7eee-4a17-ae13-85a707ff0d8b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:02.246545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d814e-7eee-4a17-ae13-85a707ff0d8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:02.247388 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d814e-7eee-4a17-ae13-85a707ff0d8b None admin] RBAC: Adding query filter params (group.id=2d6fbab3cb394bddbf30de888599eff7, role.id=9b6d2d07e37f449699fd25de81ee509a, scope.project.id=427007497a734b6ab72d65a07f3dcbb7) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:02.247730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d814e-7eee-4a17-ae13-85a707ff0d8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:02.250122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d814e-7eee-4a17-ae13-85a707ff0d8b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:02.250426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531fa82-8f75-4da2-8d63-46068d1ed2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:02.251296 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531fa82-8f75-4da2-8d63-46068d1ed2d6 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:02.251626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531fa82-8f75-4da2-8d63-46068d1ed2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:02.252053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531fa82-8f75-4da2-8d63-46068d1ed2d6 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:02.253335 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531fa82-8f75-4da2-8d63-46068d1ed2d6 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:02.255321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531fa82-8f75-4da2-8d63-46068d1ed2d6 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:02.256968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 193/369] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Apr 6 12:41:02 2022] GET /identity/v3/role_assignments?group.id=2d6fbab3cb394bddbf30de888599eff7&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:02.257294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 177/370] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:02 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:02.257762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d814e-7eee-4a17-ae13-85a707ff0d8b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:02.258253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531fa82-8f75-4da2-8d63-46068d1ed2d6 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:02.408942 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d814e-7eee-4a17-ae13-85a707ff0d8b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:02.411314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531fa82-8f75-4da2-8d63-46068d1ed2d6 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:02.464223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74e7c1-2c92-411f-8a57-27d105091e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:02.464893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74e7c1-2c92-411f-8a57-27d105091e48 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:02.465182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74e7c1-2c92-411f-8a57-27d105091e48 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:02.465644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74e7c1-2c92-411f-8a57-27d105091e48 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:02.467014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74e7c1-2c92-411f-8a57-27d105091e48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:02.467014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74e7c1-2c92-411f-8a57-27d105091e48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:02.468096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae368b-de8f-4e9a-bfd8-5784fb293ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:02.469001 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74e7c1-2c92-411f-8a57-27d105091e48 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:02.469822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae368b-de8f-4e9a-bfd8-5784fb293ac4 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:02.470181 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae368b-de8f-4e9a-bfd8-5784fb293ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:02.470532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae368b-de8f-4e9a-bfd8-5784fb293ac4 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:02.471986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae368b-de8f-4e9a-bfd8-5784fb293ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:02.480038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eae368b-de8f-4e9a-bfd8-5784fb293ac4 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:02.480239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 194/371] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:02.480239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74e7c1-2c92-411f-8a57-27d105091e48 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:02.482561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 178/372] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:02 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:02.485552 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae368b-de8f-4e9a-bfd8-5784fb293ac4 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:02.612264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74e7c1-2c92-411f-8a57-27d105091e48 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:02.629242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae368b-de8f-4e9a-bfd8-5784fb293ac4 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:02.649941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d103c-5d2d-4bb5-b979-2ba3fe8f3018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:02.651935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d103c-5d2d-4bb5-b979-2ba3fe8f3018 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:02.652275 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d103c-5d2d-4bb5-b979-2ba3fe8f3018 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:02.652559 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d103c-5d2d-4bb5-b979-2ba3fe8f3018 None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:02.654737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d103c-5d2d-4bb5-b979-2ba3fe8f3018 None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:02.656443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d103c-5d2d-4bb5-b979-2ba3fe8f3018 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:02.658395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 195/373] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:02 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:02.658981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d103c-5d2d-4bb5-b979-2ba3fe8f3018 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:02.681461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e70e74-0e8a-4144-9b66-65dbc71a3bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:02.682733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e70e74-0e8a-4144-9b66-65dbc71a3bb5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:02.683214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e70e74-0e8a-4144-9b66-65dbc71a3bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:02.683681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e70e74-0e8a-4144-9b66-65dbc71a3bb5 None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:02.685476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e70e74-0e8a-4144-9b66-65dbc71a3bb5 None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:02.687736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e70e74-0e8a-4144-9b66-65dbc71a3bb5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:02.690793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 179/374] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:02 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:02.691996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e70e74-0e8a-4144-9b66-65dbc71a3bb5 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:02.795660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d103c-5d2d-4bb5-b979-2ba3fe8f3018 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:02.829540 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e70e74-0e8a-4144-9b66-65dbc71a3bb5 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:02.840612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa07a1-f15f-45a4-9635-5f0e1d79fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:02.842700 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa07a1-f15f-45a4-9635-5f0e1d79fccf None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:02.843501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa07a1-f15f-45a4-9635-5f0e1d79fccf None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:02.844390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa07a1-f15f-45a4-9635-5f0e1d79fccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:02.877003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad3f90-4b42-4ccc-98a0-edb0602ea277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:02.877766 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad3f90-4b42-4ccc-98a0-edb0602ea277 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:02.878054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad3f90-4b42-4ccc-98a0-edb0602ea277 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:02.878332 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad3f90-4b42-4ccc-98a0-edb0602ea277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:02.879238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad3f90-4b42-4ccc-98a0-edb0602ea277 None admin] RBAC: Adding query filter params (group.id=2d6fbab3cb394bddbf30de888599eff7, role.id=82e7000d778e4c66a98f07a93e8ae084, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:02.879553 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad3f90-4b42-4ccc-98a0-edb0602ea277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:02.881094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad3f90-4b42-4ccc-98a0-edb0602ea277 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:02.887251 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 180/375] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Apr 6 12:41:02 2022] GET /identity/v3/role_assignments?group.id=2d6fbab3cb394bddbf30de888599eff7&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=82e7000d778e4c66a98f07a93e8ae084 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:02.888083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad3f90-4b42-4ccc-98a0-edb0602ea277 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:02.932103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa07a1-f15f-45a4-9635-5f0e1d79fccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:02.937371 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa07a1-f15f-45a4-9635-5f0e1d79fccf None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:03.061843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad3f90-4b42-4ccc-98a0-edb0602ea277 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:03.114085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 196/376] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:03.127430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5ddf1-a2ae-4c92-bcf9-9fba0ad866c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:03.128510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5ddf1-a2ae-4c92-bcf9-9fba0ad866c9 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:03.129106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5ddf1-a2ae-4c92-bcf9-9fba0ad866c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:03.129629 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5ddf1-a2ae-4c92-bcf9-9fba0ad866c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:03.130720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5ddf1-a2ae-4c92-bcf9-9fba0ad866c9 None admin] RBAC: Adding query filter params (group.id=2d6fbab3cb394bddbf30de888599eff7, role.id=82e7000d778e4c66a98f07a93e8ae084, scope.project.id=427007497a734b6ab72d65a07f3dcbb7) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:03.131238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5ddf1-a2ae-4c92-bcf9-9fba0ad866c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:03.133116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5ddf1-a2ae-4c92-bcf9-9fba0ad866c9 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:03.139540 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa07a1-f15f-45a4-9635-5f0e1d79fccf None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:03.141503 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 181/377] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Apr 6 12:41:02 2022] GET /identity/v3/role_assignments?group.id=2d6fbab3cb394bddbf30de888599eff7&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=82e7000d778e4c66a98f07a93e8ae084 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:03.280807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa07a1-f15f-45a4-9635-5f0e1d79fccf None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:03.330152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0a260-03d2-4c54-95b7-c39469a7aaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:03.330949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a260-03d2-4c54-95b7-c39469a7aaab None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:03.331227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a260-03d2-4c54-95b7-c39469a7aaab None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:03.331498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a260-03d2-4c54-95b7-c39469a7aaab None admin] PATH_INFO: `/v3/projects/0ae146b1346144a8a304973b35877975` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:03.338870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0a260-03d2-4c54-95b7-c39469a7aaab None admin] RBAC: Authorizing `identity:get_project(project_id=0ae146b1346144a8a304973b35877975)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:03.341086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0a260-03d2-4c54-95b7-c39469a7aaab None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:03.345180 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 197/378] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:03 2022] GET /identity/v3/projects/0ae146b1346144a8a304973b35877975 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:03.351059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5ddf1-a2ae-4c92-bcf9-9fba0ad866c9 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:03.502430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5ddf1-a2ae-4c92-bcf9-9fba0ad866c9 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:03.538825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d8e03-97a8-4d95-a2c0-ac9c58727135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:03.540071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d8e03-97a8-4d95-a2c0-ac9c58727135 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:03.540649 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d8e03-97a8-4d95-a2c0-ac9c58727135 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:03.541180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d8e03-97a8-4d95-a2c0-ac9c58727135 None admin] PATH_INFO: `/v3/groups/b4bebe0aa83d4c128349222a887a9dbc` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:03.546482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d8e03-97a8-4d95-a2c0-ac9c58727135 None admin] RBAC: Authorizing `identity:get_group(group_id=b4bebe0aa83d4c128349222a887a9dbc)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:03.548220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d8e03-97a8-4d95-a2c0-ac9c58727135 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:03.550636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 182/379] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:03 2022] GET /identity/v3/groups/b4bebe0aa83d4c128349222a887a9dbc => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:03.558648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0a260-03d2-4c54-95b7-c39469a7aaab None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:03.566025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067a665-0725-4da3-a4fb-f118b5c89f54 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:03.566317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067a665-0725-4da3-a4fb-f118b5c89f54 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:03.566599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067a665-0725-4da3-a4fb-f118b5c89f54 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:03.569161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 183/380] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:41:03.573327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5a2d-d36a-41cd-acdb-a60c2757a92b None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:03.573636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5a2d-d36a-41cd-acdb-a60c2757a92b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:03.573924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed5a2d-d36a-41cd-acdb-a60c2757a92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:03.590814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-36ed5a2d-d36a-41cd-acdb-a60c2757a92b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:03.592596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-36ed5a2d-d36a-41cd-acdb-a60c2757a92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:03.673705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 184/381] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:03.695560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed5a2d-d36a-41cd-acdb-a60c2757a92b None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:03.741658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0a260-03d2-4c54-95b7-c39469a7aaab None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:03.777083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ef182-504a-40f6-bbee-844021db4168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:03.777784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef182-504a-40f6-bbee-844021db4168 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:03.778068 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef182-504a-40f6-bbee-844021db4168 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:03.778337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ef182-504a-40f6-bbee-844021db4168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:03.779171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ef182-504a-40f6-bbee-844021db4168 None admin] RBAC: Adding query filter params (group.id=b4bebe0aa83d4c128349222a887a9dbc, role.id=c158bb1781c44a03890992161076b84b, scope.project.id=0ae146b1346144a8a304973b35877975) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:03.779589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ef182-504a-40f6-bbee-844021db4168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:03.781110 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ef182-504a-40f6-bbee-844021db4168 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:03.787412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 198/382] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Apr 6 12:41:03 2022] GET /identity/v3/role_assignments?group.id=b4bebe0aa83d4c128349222a887a9dbc&scope.project.id=0ae146b1346144a8a304973b35877975&role.id=c158bb1781c44a03890992161076b84b => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:03.827586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed5a2d-d36a-41cd-acdb-a60c2757a92b None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:03.869304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432ed2b-2607-4856-996c-fde3ec5d9072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:03.870061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ed2b-2607-4856-996c-fde3ec5d9072 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:03.870342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ed2b-2607-4856-996c-fde3ec5d9072 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:03.870610 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432ed2b-2607-4856-996c-fde3ec5d9072 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:03.884404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432ed2b-2607-4856-996c-fde3ec5d9072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:03.892417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-f432ed2b-2607-4856-996c-fde3ec5d9072 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:41:03.902221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 185/383] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:03.909035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ef182-504a-40f6-bbee-844021db4168 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:04.039545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ef182-504a-40f6-bbee-844021db4168 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:04.076907 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175ed49-cab3-4e63-b01f-0ba1bc8a024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:04.077709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175ed49-cab3-4e63-b01f-0ba1bc8a024e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:04.077871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175ed49-cab3-4e63-b01f-0ba1bc8a024e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:04.078141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175ed49-cab3-4e63-b01f-0ba1bc8a024e None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:04.078884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175ed49-cab3-4e63-b01f-0ba1bc8a024e None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:04.079186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175ed49-cab3-4e63-b01f-0ba1bc8a024e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:04.080559 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175ed49-cab3-4e63-b01f-0ba1bc8a024e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:04.096257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 199/384] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:41:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:04.103261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432ed2b-2607-4856-996c-fde3ec5d9072 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:04.222787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432ed2b-2607-4856-996c-fde3ec5d9072 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:04.261003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c98fb-a53b-4870-be6f-c3e70baf7478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:04.261893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c98fb-a53b-4870-be6f-c3e70baf7478 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:04.262172 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c98fb-a53b-4870-be6f-c3e70baf7478 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:04.262443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c98fb-a53b-4870-be6f-c3e70baf7478 None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:04.263644 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c98fb-a53b-4870-be6f-c3e70baf7478 None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:04.265257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c98fb-a53b-4870-be6f-c3e70baf7478 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:04.266918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 186/385] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:04 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:04.272682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175ed49-cab3-4e63-b01f-0ba1bc8a024e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:04.409800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175ed49-cab3-4e63-b01f-0ba1bc8a024e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:04.455489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a29e27-7865-49bc-b16c-9b3e2f56ef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:04.456509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a29e27-7865-49bc-b16c-9b3e2f56ef83 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:04.456852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a29e27-7865-49bc-b16c-9b3e2f56ef83 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:04.457182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a29e27-7865-49bc-b16c-9b3e2f56ef83 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:04.458490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a29e27-7865-49bc-b16c-9b3e2f56ef83 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:04.459938 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a29e27-7865-49bc-b16c-9b3e2f56ef83 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:04.462052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 200/386] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:04 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:04.468323 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c98fb-a53b-4870-be6f-c3e70baf7478 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:04.602417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c98fb-a53b-4870-be6f-c3e70baf7478 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:04.641254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f7e91b-18ca-4100-acfd-ec53605d6d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:04.642176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e91b-18ca-4100-acfd-ec53605d6d1d None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:04.642457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e91b-18ca-4100-acfd-ec53605d6d1d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:04.645603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f7e91b-18ca-4100-acfd-ec53605d6d1d None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/groups/2d6fbab3cb394bddbf30de888599eff7/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:04.650816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e91b-18ca-4100-acfd-ec53605d6d1d None admin] RBAC: Authorizing `identity:create_grant(project_id=42b621529bfd4baeb56fe9e133ee6b7c, group_id=2d6fbab3cb394bddbf30de888599eff7, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:04.652294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f7e91b-18ca-4100-acfd-ec53605d6d1d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:04.676138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 187/387] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Apr 6 12:41:04 2022] PUT /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/groups/2d6fbab3cb394bddbf30de888599eff7/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:05.550034 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c11db-1e2f-40c4-adbd-24366a266c70 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:05.550823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c11db-1e2f-40c4-adbd-24366a266c70 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:05.550898 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c11db-1e2f-40c4-adbd-24366a266c70 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:05.552812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 201/388] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:05.558013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b1a1-1b98-4e0b-8b56-85a46ac545c7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:05.558447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b1a1-1b98-4e0b-8b56-85a46ac545c7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:05.558653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b1a1-1b98-4e0b-8b56-85a46ac545c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:05.582273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e3d3b1a1-1b98-4e0b-8b56-85a46ac545c7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:05.583620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e3d3b1a1-1b98-4e0b-8b56-85a46ac545c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:05.672281 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 188/389] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:05.719767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c11db-1e2f-40c4-adbd-24366a266c70 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:05.852807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c11db-1e2f-40c4-adbd-24366a266c70 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:05.852971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdf65d-1268-4842-86dc-9ac8c6c97f49 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:05.853259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdf65d-1268-4842-86dc-9ac8c6c97f49 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:05.853538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdf65d-1268-4842-86dc-9ac8c6c97f49 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:05.855301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 189/390] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:05.871485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13ba6e-9bf3-4f40-80f1-716890dcd24c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:05.871778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13ba6e-9bf3-4f40-80f1-716890dcd24c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:05.872034 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13ba6e-9bf3-4f40-80f1-716890dcd24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:05.891043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd8676-0cec-478e-8ee0-d99bf64d5164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:05.892177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd8676-0cec-478e-8ee0-d99bf64d5164 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:05.892650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd8676-0cec-478e-8ee0-d99bf64d5164 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:05.893111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd8676-0cec-478e-8ee0-d99bf64d5164 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:05.903782 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd8676-0cec-478e-8ee0-d99bf64d5164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:05.910585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-0f13ba6e-9bf3-4f40-80f1-716890dcd24c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:05.911487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-e9fd8676-0cec-478e-8ee0-d99bf64d5164 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:41:05.911779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0f13ba6e-9bf3-4f40-80f1-716890dcd24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:05.913428 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 202/391] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:05.921809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd8676-0cec-478e-8ee0-d99bf64d5164 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.032735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 190/392] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:06.057545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13ba6e-9bf3-4f40-80f1-716890dcd24c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.113211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd8676-0cec-478e-8ee0-d99bf64d5164 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:06.167113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13ba6e-9bf3-4f40-80f1-716890dcd24c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:06.167465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc3e6a-45b3-444d-b6d0-d8f25df6dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:06.168130 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc3e6a-45b3-444d-b6d0-d8f25df6dd14 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.168410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc3e6a-45b3-444d-b6d0-d8f25df6dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.168682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc3e6a-45b3-444d-b6d0-d8f25df6dd14 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.169426 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc3e6a-45b3-444d-b6d0-d8f25df6dd14 None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:06.169765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc3e6a-45b3-444d-b6d0-d8f25df6dd14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:06.172165 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc3e6a-45b3-444d-b6d0-d8f25df6dd14 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:06.181734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 203/393] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:41:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:06.183160 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb2c8-6b51-48ea-8823-9cc834324ed5 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.183448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb2c8-6b51-48ea-8823-9cc834324ed5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.183759 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cb2c8-6b51-48ea-8823-9cc834324ed5 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.185174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 204/394] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:06.190319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb2c8-6b51-48ea-8823-9cc834324ed5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.203740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4b497-736e-4574-b33d-0876968768ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:06.204695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4b497-736e-4574-b33d-0876968768ad None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.204989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4b497-736e-4574-b33d-0876968768ad None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.205306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4b497-736e-4574-b33d-0876968768ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.216133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4b497-736e-4574-b33d-0876968768ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:06.224950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-fec4b497-736e-4574-b33d-0876968768ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:41:06.226729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 191/395] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:41:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:06.227922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82c9e-94a9-4a3e-8b76-7ae285f36548 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.228206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82c9e-94a9-4a3e-8b76-7ae285f36548 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.228477 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82c9e-94a9-4a3e-8b76-7ae285f36548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.252263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3ed82c9e-94a9-4a3e-8b76-7ae285f36548 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:06.253728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3ed82c9e-94a9-4a3e-8b76-7ae285f36548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:06.296557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cb2c8-6b51-48ea-8823-9cc834324ed5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:06.334321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 192/396] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:06.334997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed82c9e-94a9-4a3e-8b76-7ae285f36548 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.356952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e710e6-cfac-455a-8718-35d9f36f105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:06.358578 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e710e6-cfac-455a-8718-35d9f36f105f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.359018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e710e6-cfac-455a-8718-35d9f36f105f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.359429 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e710e6-cfac-455a-8718-35d9f36f105f None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.361636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e710e6-cfac-455a-8718-35d9f36f105f None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:06.363294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e710e6-cfac-455a-8718-35d9f36f105f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:06.365453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 205/397] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:06 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:06.366391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e710e6-cfac-455a-8718-35d9f36f105f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.453113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed82c9e-94a9-4a3e-8b76-7ae285f36548 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:06.470372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e710e6-cfac-455a-8718-35d9f36f105f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:06.489650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046964b9-73d2-49fd-969d-b929ce814f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:06.490318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046964b9-73d2-49fd-969d-b929ce814f05 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.490605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046964b9-73d2-49fd-969d-b929ce814f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.490881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046964b9-73d2-49fd-969d-b929ce814f05 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.491701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046964b9-73d2-49fd-969d-b929ce814f05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:06.491926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046964b9-73d2-49fd-969d-b929ce814f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:06.493320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046964b9-73d2-49fd-969d-b929ce814f05 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:06.505305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 193/398] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:06.506399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046964b9-73d2-49fd-969d-b929ce814f05 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.510732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05027c-2141-45a8-b925-b3a26d2557ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:06.511717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05027c-2141-45a8-b925-b3a26d2557ae None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.512153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05027c-2141-45a8-b925-b3a26d2557ae None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.512614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05027c-2141-45a8-b925-b3a26d2557ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.524585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05027c-2141-45a8-b925-b3a26d2557ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:06.533097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-2f05027c-2141-45a8-b925-b3a26d2557ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:41:06.534923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 206/399] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:41:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:06.535850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05027c-2141-45a8-b925-b3a26d2557ae None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.627479 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046964b9-73d2-49fd-969d-b929ce814f05 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:06.647047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05027c-2141-45a8-b925-b3a26d2557ae None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:06.662458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ee02e-a94f-4724-bca1-aa5feec942c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:06.663532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ee02e-a94f-4724-bca1-aa5feec942c4 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.664052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ee02e-a94f-4724-bca1-aa5feec942c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.664461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ee02e-a94f-4724-bca1-aa5feec942c4 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.665828 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ee02e-a94f-4724-bca1-aa5feec942c4 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:06.667440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ee02e-a94f-4724-bca1-aa5feec942c4 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:06.669607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 194/400] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:06 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:06.670905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ee02e-a94f-4724-bca1-aa5feec942c4 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.686478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24018d-4891-41cb-b7ae-3c36510ffee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:06.687344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24018d-4891-41cb-b7ae-3c36510ffee2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.687901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24018d-4891-41cb-b7ae-3c36510ffee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.688040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24018d-4891-41cb-b7ae-3c36510ffee2 None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.689582 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24018d-4891-41cb-b7ae-3c36510ffee2 None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:06.691300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24018d-4891-41cb-b7ae-3c36510ffee2 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:06.697529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 207/401] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:06 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:06.698380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24018d-4891-41cb-b7ae-3c36510ffee2 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.771048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ee02e-a94f-4724-bca1-aa5feec942c4 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:06.803843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24018d-4891-41cb-b7ae-3c36510ffee2 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:06.807095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d63bd3-9a46-4873-a2e8-557174ecb78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:06.807777 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d63bd3-9a46-4873-a2e8-557174ecb78a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.808061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d63bd3-9a46-4873-a2e8-557174ecb78a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.808338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d63bd3-9a46-4873-a2e8-557174ecb78a None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.809080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d63bd3-9a46-4873-a2e8-557174ecb78a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:06.809386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d63bd3-9a46-4873-a2e8-557174ecb78a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:06.811599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d63bd3-9a46-4873-a2e8-557174ecb78a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:06.819837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 195/402] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:06.820738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d63bd3-9a46-4873-a2e8-557174ecb78a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.844477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea52fe2-8fd5-43cd-8672-d1bbbe46ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:06.845494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea52fe2-8fd5-43cd-8672-d1bbbe46ac13 None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.845971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea52fe2-8fd5-43cd-8672-d1bbbe46ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.846257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea52fe2-8fd5-43cd-8672-d1bbbe46ac13 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7/groups/2d6fbab3cb394bddbf30de888599eff7/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.848527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea52fe2-8fd5-43cd-8672-d1bbbe46ac13 None admin] RBAC: Authorizing `identity:create_grant(project_id=427007497a734b6ab72d65a07f3dcbb7, group_id=2d6fbab3cb394bddbf30de888599eff7, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:06.850297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea52fe2-8fd5-43cd-8672-d1bbbe46ac13 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:06.874347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 208/403] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Apr 6 12:41:06 2022] PUT /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7/groups/2d6fbab3cb394bddbf30de888599eff7/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:06.874347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18204-dae2-4b1b-be3a-4ba8354a7c53 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.874347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18204-dae2-4b1b-be3a-4ba8354a7c53 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.874347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18204-dae2-4b1b-be3a-4ba8354a7c53 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.874347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 209/404] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:06.874347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e18204-dae2-4b1b-be3a-4ba8354a7c53 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:06.943413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d63bd3-9a46-4873-a2e8-557174ecb78a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:06.989557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadb188-4ea7-42c9-b712-9ec5593b6737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:06.990746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadb188-4ea7-42c9-b712-9ec5593b6737 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.991182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadb188-4ea7-42c9-b712-9ec5593b6737 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.991783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadb188-4ea7-42c9-b712-9ec5593b6737 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:06.993349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadb188-4ea7-42c9-b712-9ec5593b6737 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:06.994957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadb188-4ea7-42c9-b712-9ec5593b6737 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:06.997105 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 196/405] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:06 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:06.999076 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fcb9b-634c-4154-a788-e937131f859c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:06.999369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fcb9b-634c-4154-a788-e937131f859c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:06.999700 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fcb9b-634c-4154-a788-e937131f859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:07.005633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e18204-dae2-4b1b-be3a-4ba8354a7c53 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:07.022877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-cb1fcb9b-634c-4154-a788-e937131f859c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:07.024844 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-cb1fcb9b-634c-4154-a788-e937131f859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:07.047508 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40860fcd-244e-4f47-9c37-db3b92b425d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:07.048378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860fcd-244e-4f47-9c37-db3b92b425d3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:07.048728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860fcd-244e-4f47-9c37-db3b92b425d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:07.049153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40860fcd-244e-4f47-9c37-db3b92b425d3 None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:07.051252 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40860fcd-244e-4f47-9c37-db3b92b425d3 None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:07.053188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40860fcd-244e-4f47-9c37-db3b92b425d3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:07.061817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 210/406] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:06 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:07.062933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40860fcd-244e-4f47-9c37-db3b92b425d3 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:07.111149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 197/407] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:07.111934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fcb9b-634c-4154-a788-e937131f859c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:07.192860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40860fcd-244e-4f47-9c37-db3b92b425d3 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:07.234139 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147409e-0442-4909-8a41-aeb2bc9cb4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:07.235752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147409e-0442-4909-8a41-aeb2bc9cb4ce None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:07.236432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147409e-0442-4909-8a41-aeb2bc9cb4ce None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:07.237083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147409e-0442-4909-8a41-aeb2bc9cb4ce None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/groups/2d6fbab3cb394bddbf30de888599eff7/roles/82e7000d778e4c66a98f07a93e8ae084` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:07.237876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fcb9b-634c-4154-a788-e937131f859c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:07.239819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147409e-0442-4909-8a41-aeb2bc9cb4ce None admin] RBAC: Authorizing `identity:create_grant(project_id=42b621529bfd4baeb56fe9e133ee6b7c, group_id=2d6fbab3cb394bddbf30de888599eff7, role_id=82e7000d778e4c66a98f07a93e8ae084)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:07.241467 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8147409e-0442-4909-8a41-aeb2bc9cb4ce None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:07.260210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 211/408] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Apr 6 12:41:07 2022] PUT /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c/groups/2d6fbab3cb394bddbf30de888599eff7/roles/82e7000d778e4c66a98f07a93e8ae084 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:07.261797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147409e-0442-4909-8a41-aeb2bc9cb4ce None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:07.274317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f0c26-2175-4756-924b-2ca6b5e9af73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:07.275305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f0c26-2175-4756-924b-2ca6b5e9af73 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:07.275567 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f0c26-2175-4756-924b-2ca6b5e9af73 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:07.275893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f0c26-2175-4756-924b-2ca6b5e9af73 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:07.277276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f0c26-2175-4756-924b-2ca6b5e9af73 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:07.278905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f0c26-2175-4756-924b-2ca6b5e9af73 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:07.280873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 198/409] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:07 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:07.286664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f0c26-2175-4756-924b-2ca6b5e9af73 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:07.392975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147409e-0442-4909-8a41-aeb2bc9cb4ce None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:07.415443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f0c26-2175-4756-924b-2ca6b5e9af73 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:07.434361 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babcdc3-56dc-4cab-bf44-847f9e2c5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:07.435168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcdc3-56dc-4cab-bf44-847f9e2c5adf None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:07.436038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcdc3-56dc-4cab-bf44-847f9e2c5adf None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:07.436272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babcdc3-56dc-4cab-bf44-847f9e2c5adf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:07.447006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babcdc3-56dc-4cab-bf44-847f9e2c5adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:07.454050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-0babcdc3-56dc-4cab-bf44-847f9e2c5adf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:41:07.455577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 212/410] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:07.461030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babcdc3-56dc-4cab-bf44-847f9e2c5adf None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:07.465528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab3b6-7f68-4f17-84be-e2bb17f24770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:07.468219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab3b6-7f68-4f17-84be-e2bb17f24770 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:07.468672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab3b6-7f68-4f17-84be-e2bb17f24770 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:07.469122 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ab3b6-7f68-4f17-84be-e2bb17f24770 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7/groups/2d6fbab3cb394bddbf30de888599eff7/roles/82e7000d778e4c66a98f07a93e8ae084` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:07.482000 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ab3b6-7f68-4f17-84be-e2bb17f24770 None admin] RBAC: Authorizing `identity:create_grant(project_id=427007497a734b6ab72d65a07f3dcbb7, group_id=2d6fbab3cb394bddbf30de888599eff7, role_id=82e7000d778e4c66a98f07a93e8ae084)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:07.484423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ab3b6-7f68-4f17-84be-e2bb17f24770 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:07.502625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 199/411] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Apr 6 12:41:07 2022] PUT /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7/groups/2d6fbab3cb394bddbf30de888599eff7/roles/82e7000d778e4c66a98f07a93e8ae084 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:07.604297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babcdc3-56dc-4cab-bf44-847f9e2c5adf None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:07.643500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb11924-2280-4ac2-98a1-3c2b28ac8334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:07.643704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11924-2280-4ac2-98a1-3c2b28ac8334 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:07.643931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11924-2280-4ac2-98a1-3c2b28ac8334 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:07.644128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11924-2280-4ac2-98a1-3c2b28ac8334 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:07.644889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb11924-2280-4ac2-98a1-3c2b28ac8334 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:07.645195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb11924-2280-4ac2-98a1-3c2b28ac8334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:07.646662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb11924-2280-4ac2-98a1-3c2b28ac8334 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:07.657761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 213/412] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:07.664715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab3b6-7f68-4f17-84be-e2bb17f24770 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:07.731218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3a67e-3a31-4e29-abce-9b00fbe1ae11 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:07.731562 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3a67e-3a31-4e29-abce-9b00fbe1ae11 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:07.731767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3a67e-3a31-4e29-abce-9b00fbe1ae11 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:07.734263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 214/413] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:07.740711 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067e53-e30d-4430-9515-358d326916f3 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:07.740987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067e53-e30d-4430-9515-358d326916f3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:07.741189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a067e53-e30d-4430-9515-358d326916f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:07.770065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3a067e53-e30d-4430-9515-358d326916f3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:07.771384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3a067e53-e30d-4430-9515-358d326916f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:07.807776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ab3b6-7f68-4f17-84be-e2bb17f24770 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:07.854355 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f67fe3-d862-4638-860a-1679939b99f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:07.855539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f67fe3-d862-4638-860a-1679939b99f7 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:07.855980 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f67fe3-d862-4638-860a-1679939b99f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:07.856470 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f67fe3-d862-4638-860a-1679939b99f7 None admin] PATH_INFO: `/v3/groups/b4bebe0aa83d4c128349222a887a9dbc` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:07.858894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f67fe3-d862-4638-860a-1679939b99f7 None admin] RBAC: Authorizing `identity:get_group(group_id=b4bebe0aa83d4c128349222a887a9dbc)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:07.861146 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f67fe3-d862-4638-860a-1679939b99f7 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:07.863380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 200/414] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:07 2022] GET /identity/v3/groups/b4bebe0aa83d4c128349222a887a9dbc => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:07.869277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f67fe3-d862-4638-860a-1679939b99f7 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:07.873129 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 215/415] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:07.898796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a067e53-e30d-4430-9515-358d326916f3 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:07.978523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f67fe3-d862-4638-860a-1679939b99f7 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:08.011760 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eb2eb-4837-486b-87d2-3b37794d67f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:08.012558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb2eb-4837-486b-87d2-3b37794d67f1 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:08.012838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb2eb-4837-486b-87d2-3b37794d67f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:08.013110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb2eb-4837-486b-87d2-3b37794d67f1 None admin] PATH_INFO: `/v3/projects/0ae146b1346144a8a304973b35877975` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:08.016162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eb2eb-4837-486b-87d2-3b37794d67f1 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae146b1346144a8a304973b35877975)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:08.020402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eb2eb-4837-486b-87d2-3b37794d67f1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:08.022367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 201/416] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:07 2022] GET /identity/v3/projects/0ae146b1346144a8a304973b35877975 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:08.028330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eb2eb-4837-486b-87d2-3b37794d67f1 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:08.114621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a067e53-e30d-4430-9515-358d326916f3 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:08.182890 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c77426-c3ee-4967-a876-c2f6db220b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:08.183712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c77426-c3ee-4967-a876-c2f6db220b4a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:08.183994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c77426-c3ee-4967-a876-c2f6db220b4a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:08.184268 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c77426-c3ee-4967-a876-c2f6db220b4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:08.202097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c77426-c3ee-4967-a876-c2f6db220b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:08.210244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-07c77426-c3ee-4967-a876-c2f6db220b4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:41:08.214122 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eb2eb-4837-486b-87d2-3b37794d67f1 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:08.216423 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 216/417] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:08.225534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c77426-c3ee-4967-a876-c2f6db220b4a None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:08.280426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39a82f-1b6a-4bd8-a9ca-571231dfaca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:08.281378 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39a82f-1b6a-4bd8-a9ca-571231dfaca8 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:08.283048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39a82f-1b6a-4bd8-a9ca-571231dfaca8 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:08.283338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39a82f-1b6a-4bd8-a9ca-571231dfaca8 None admin] PATH_INFO: `/v3/projects/0ae146b1346144a8a304973b35877975/groups/b4bebe0aa83d4c128349222a887a9dbc/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:08.286182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39a82f-1b6a-4bd8-a9ca-571231dfaca8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ae146b1346144a8a304973b35877975, group_id=b4bebe0aa83d4c128349222a887a9dbc, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:08.290620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39a82f-1b6a-4bd8-a9ca-571231dfaca8 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:08.315080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 202/418] 10.222.0.23 () {58 vars in 1442 bytes} [Wed Apr 6 12:41:08 2022] PUT /identity/v3/projects/0ae146b1346144a8a304973b35877975/groups/b4bebe0aa83d4c128349222a887a9dbc/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:08.402076 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c77426-c3ee-4967-a876-c2f6db220b4a None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:08.450474 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40b593-4934-46aa-a6cd-f4de6d4f6d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:08.451636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40b593-4934-46aa-a6cd-f4de6d4f6d8f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:08.452005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40b593-4934-46aa-a6cd-f4de6d4f6d8f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:08.452320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40b593-4934-46aa-a6cd-f4de6d4f6d8f None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:08.453093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40b593-4934-46aa-a6cd-f4de6d4f6d8f None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:08.453462 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40b593-4934-46aa-a6cd-f4de6d4f6d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:08.454944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40b593-4934-46aa-a6cd-f4de6d4f6d8f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:08.470052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 217/419] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:41:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:08.475734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39a82f-1b6a-4bd8-a9ca-571231dfaca8 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:08.596308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39a82f-1b6a-4bd8-a9ca-571231dfaca8 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:08.634666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d5500-ff25-4967-8777-bddec2a96623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:08.635325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d5500-ff25-4967-8777-bddec2a96623 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:08.635608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d5500-ff25-4967-8777-bddec2a96623 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:08.635889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d5500-ff25-4967-8777-bddec2a96623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:08.718751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d5500-ff25-4967-8777-bddec2a96623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:08.720261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d5500-ff25-4967-8777-bddec2a96623 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:08.845657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 203/420] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:08.850820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40b593-4934-46aa-a6cd-f4de6d4f6d8f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:08.981435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40b593-4934-46aa-a6cd-f4de6d4f6d8f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:09.019065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329e218-9514-4d17-8a76-ed32e54a1069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:09.020840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329e218-9514-4d17-8a76-ed32e54a1069 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:09.021138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329e218-9514-4d17-8a76-ed32e54a1069 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:09.021419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329e218-9514-4d17-8a76-ed32e54a1069 None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:09.022950 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329e218-9514-4d17-8a76-ed32e54a1069 None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:09.024408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329e218-9514-4d17-8a76-ed32e54a1069 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:09.026460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 218/421] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:08 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:09.034982 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d5500-ff25-4967-8777-bddec2a96623 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:09.178051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d5500-ff25-4967-8777-bddec2a96623 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:09.215118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40dc43-c6d0-43ed-baca-912410e5994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:09.216217 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40dc43-c6d0-43ed-baca-912410e5994f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:09.216697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40dc43-c6d0-43ed-baca-912410e5994f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:09.217185 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40dc43-c6d0-43ed-baca-912410e5994f None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:09.218707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40dc43-c6d0-43ed-baca-912410e5994f None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:09.220811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40dc43-c6d0-43ed-baca-912410e5994f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:09.223189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 204/422] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:09 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:09.228599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329e218-9514-4d17-8a76-ed32e54a1069 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:09.389308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329e218-9514-4d17-8a76-ed32e54a1069 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:09.435991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ba3bd-14c3-4d46-bb82-b64cfa54ef34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:09.436527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ba3bd-14c3-4d46-bb82-b64cfa54ef34 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:09.436804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ba3bd-14c3-4d46-bb82-b64cfa54ef34 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:09.437075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ba3bd-14c3-4d46-bb82-b64cfa54ef34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:09.437930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ba3bd-14c3-4d46-bb82-b64cfa54ef34 None admin] RBAC: Adding query filter params (group.id=2d6fbab3cb394bddbf30de888599eff7, role.id=9b6d2d07e37f449699fd25de81ee509a, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:09.438239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ba3bd-14c3-4d46-bb82-b64cfa54ef34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:09.439677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ba3bd-14c3-4d46-bb82-b64cfa54ef34 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:09.450235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 219/423] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Apr 6 12:41:09 2022] GET /identity/v3/role_assignments?group.id=2d6fbab3cb394bddbf30de888599eff7&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:09.672595 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b2c3a-b829-4228-baca-fb4f360b6c5c None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:09.672935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b2c3a-b829-4228-baca-fb4f360b6c5c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:09.673409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b2c3a-b829-4228-baca-fb4f360b6c5c None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:09.675551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 205/424] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:09.681440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475316a-4637-43ac-aec3-53bc7a47cdc5 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:09.681965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475316a-4637-43ac-aec3-53bc7a47cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:09.682462 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475316a-4637-43ac-aec3-53bc7a47cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:09.707212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-a475316a-4637-43ac-aec3-53bc7a47cdc5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:09.708612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a475316a-4637-43ac-aec3-53bc7a47cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:09.924733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 220/425] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:09.952881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b2c3a-b829-4228-baca-fb4f360b6c5c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:10.096131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b2c3a-b829-4228-baca-fb4f360b6c5c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:10.134547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5fb3f-4334-4d79-b090-515be5c7d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:10.135718 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5fb3f-4334-4d79-b090-515be5c7d42b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:10.136198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5fb3f-4334-4d79-b090-515be5c7d42b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:10.136665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5fb3f-4334-4d79-b090-515be5c7d42b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:10.152457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5fb3f-4334-4d79-b090-515be5c7d42b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:10.160511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-4cf5fb3f-4334-4d79-b090-515be5c7d42b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 06 12:41:10.162332 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 206/426] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:10.169559 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475316a-4637-43ac-aec3-53bc7a47cdc5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:10.293819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb82088-f41d-43a7-a900-0f79c2c73fcc None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:10.294192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475316a-4637-43ac-aec3-53bc7a47cdc5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:10.294756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb82088-f41d-43a7-a900-0f79c2c73fcc None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:10.295354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb82088-f41d-43a7-a900-0f79c2c73fcc None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:10.297216 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 207/427] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:10.303512 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bcc52-5c90-43f5-be53-937702429655 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:10.304072 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bcc52-5c90-43f5-be53-937702429655 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:10.304563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bcc52-5c90-43f5-be53-937702429655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:10.328704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-eb1bcc52-5c90-43f5-be53-937702429655 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:10.331190 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-eb1bcc52-5c90-43f5-be53-937702429655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:10.337952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eee47a-cb38-429e-9399-3dda4a9c6273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:10.337952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eee47a-cb38-429e-9399-3dda4a9c6273 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:10.337952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eee47a-cb38-429e-9399-3dda4a9c6273 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:10.338256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eee47a-cb38-429e-9399-3dda4a9c6273 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:10.339054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eee47a-cb38-429e-9399-3dda4a9c6273 None admin] RBAC: Adding query filter params (name=member) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:10.339361 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eee47a-cb38-429e-9399-3dda4a9c6273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:10.340836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eee47a-cb38-429e-9399-3dda4a9c6273 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:10.352790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 221/428] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:41:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:10.358801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eee47a-cb38-429e-9399-3dda4a9c6273 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:10.431439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 208/429] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:10.459446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bcc52-5c90-43f5-be53-937702429655 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:10.470815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eee47a-cb38-429e-9399-3dda4a9c6273 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:10.526274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7c2c-6366-424b-80b9-6675ee4ae0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:10.526932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7c2c-6366-424b-80b9-6675ee4ae0a3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:10.527218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7c2c-6366-424b-80b9-6675ee4ae0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:10.527547 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7c2c-6366-424b-80b9-6675ee4ae0a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:10.589532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bcc52-5c90-43f5-be53-937702429655 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:10.604984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f7c2c-6366-424b-80b9-6675ee4ae0a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:10.606419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f7c2c-6366-424b-80b9-6675ee4ae0a3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:10.631064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeebc4-e5f3-4f4e-bea3-ad0ba245b517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:10.631900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeebc4-e5f3-4f4e-bea3-ad0ba245b517 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:10.632183 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeebc4-e5f3-4f4e-bea3-ad0ba245b517 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:10.632460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeebc4-e5f3-4f4e-bea3-ad0ba245b517 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:10.643060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeebc4-e5f3-4f4e-bea3-ad0ba245b517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:10.650351 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-3aaeebc4-e5f3-4f4e-bea3-ad0ba245b517 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:41:10.651738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 209/430] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:41:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:10.652751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d47d-a59c-4097-ad05-50b7327d6e0e None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:10.653037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d47d-a59c-4097-ad05-50b7327d6e0e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:10.653308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d47d-a59c-4097-ad05-50b7327d6e0e None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:10.654854 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 210/431] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:10.660502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fd1fe-6e60-441c-bc2d-9de4c21f70e5 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:10.660794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fd1fe-6e60-441c-bc2d-9de4c21f70e5 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:10.661070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fd1fe-6e60-441c-bc2d-9de4c21f70e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:10.678290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-de5fd1fe-6e60-441c-bc2d-9de4c21f70e5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:10.679470 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-de5fd1fe-6e60-441c-bc2d-9de4c21f70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:10.716590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 222/432] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 12:41:10.717801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7c2c-6366-424b-80b9-6675ee4ae0a3 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:10.765604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 211/433] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:10.765604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fd1fe-6e60-441c-bc2d-9de4c21f70e5 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:10.834170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7c2c-6366-424b-80b9-6675ee4ae0a3 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:10.863626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fd1fe-6e60-441c-bc2d-9de4c21f70e5 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:10.867385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd09ead-285b-4181-b95e-80d62661f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:10.868067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09ead-285b-4181-b95e-80d62661f82f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:10.868351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09ead-285b-4181-b95e-80d62661f82f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:10.868625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09ead-285b-4181-b95e-80d62661f82f None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:10.869379 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd09ead-285b-4181-b95e-80d62661f82f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:10.869902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd09ead-285b-4181-b95e-80d62661f82f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:10.871376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd09ead-285b-4181-b95e-80d62661f82f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:10.880304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 223/434] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:10.885353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd09ead-285b-4181-b95e-80d62661f82f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:10.898922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcd895-1ba5-4cee-a787-ae844247ce96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:10.900033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd895-1ba5-4cee-a787-ae844247ce96 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:10.900474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd895-1ba5-4cee-a787-ae844247ce96 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:10.900994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd895-1ba5-4cee-a787-ae844247ce96 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:10.902387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcd895-1ba5-4cee-a787-ae844247ce96 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:10.903990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcd895-1ba5-4cee-a787-ae844247ce96 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:10.906184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 212/435] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:10 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:10.907109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcd895-1ba5-4cee-a787-ae844247ce96 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:10.992457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd09ead-285b-4181-b95e-80d62661f82f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.014510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcd895-1ba5-4cee-a787-ae844247ce96 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.028182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8fabe-f411-4d34-b66d-58c190cb7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:11.029071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8fabe-f411-4d34-b66d-58c190cb7b55 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.029372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8fabe-f411-4d34-b66d-58c190cb7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.030310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8fabe-f411-4d34-b66d-58c190cb7b55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.040569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8fabe-f411-4d34-b66d-58c190cb7b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:11.048120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0706f3-8dfd-4a09-bf05-99fcbe09f26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:11.048770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0706f3-8dfd-4a09-bf05-99fcbe09f26b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.048870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-aed8fabe-f411-4d34-b66d-58c190cb7b55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:41:11.049052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0706f3-8dfd-4a09-bf05-99fcbe09f26b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.049327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0706f3-8dfd-4a09-bf05-99fcbe09f26b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.050025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 224/436] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:41:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:11.051052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8fabe-f411-4d34-b66d-58c190cb7b55 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:11.120349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0706f3-8dfd-4a09-bf05-99fcbe09f26b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:11.121788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0706f3-8dfd-4a09-bf05-99fcbe09f26b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:11.157665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8fabe-f411-4d34-b66d-58c190cb7b55 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.194825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cb3f4-7a52-404a-985b-5b1cb0599269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:11.195678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb3f4-7a52-404a-985b-5b1cb0599269 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.195959 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb3f4-7a52-404a-985b-5b1cb0599269 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.196237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb3f4-7a52-404a-985b-5b1cb0599269 None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.197435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cb3f4-7a52-404a-985b-5b1cb0599269 None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:11.198915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cb3f4-7a52-404a-985b-5b1cb0599269 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:11.200531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 225/437] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:11 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:11.201513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cb3f4-7a52-404a-985b-5b1cb0599269 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:11.227899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 213/438] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:11.229011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0706f3-8dfd-4a09-bf05-99fcbe09f26b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:11.312129 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cb3f4-7a52-404a-985b-5b1cb0599269 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.324278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0706f3-8dfd-4a09-bf05-99fcbe09f26b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.350649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ec966-15fb-4acf-b3a1-63c047a328d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:11.351316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ec966-15fb-4acf-b3a1-63c047a328d2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.351595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ec966-15fb-4acf-b3a1-63c047a328d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.351918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ec966-15fb-4acf-b3a1-63c047a328d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.352669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ec966-15fb-4acf-b3a1-63c047a328d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:11.352974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ec966-15fb-4acf-b3a1-63c047a328d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:11.354377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ec966-15fb-4acf-b3a1-63c047a328d2 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:11.362881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 226/439] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:11.363656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ec966-15fb-4acf-b3a1-63c047a328d2 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:11.368917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1202e99-ff03-4a5f-8ee9-9dada3db3dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:11.369596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202e99-ff03-4a5f-8ee9-9dada3db3dbc None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.369874 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202e99-ff03-4a5f-8ee9-9dada3db3dbc None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.370148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1202e99-ff03-4a5f-8ee9-9dada3db3dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.371025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202e99-ff03-4a5f-8ee9-9dada3db3dbc None admin] RBAC: Adding query filter params (group.id=2d6fbab3cb394bddbf30de888599eff7, role.id=9b6d2d07e37f449699fd25de81ee509a, scope.project.id=427007497a734b6ab72d65a07f3dcbb7) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:11.371288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202e99-ff03-4a5f-8ee9-9dada3db3dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:11.372735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1202e99-ff03-4a5f-8ee9-9dada3db3dbc None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:11.378533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 214/440] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Apr 6 12:41:11 2022] GET /identity/v3/role_assignments?group.id=2d6fbab3cb394bddbf30de888599eff7&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=9b6d2d07e37f449699fd25de81ee509a => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:11.379734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a61b-c962-4c76-bb80-826433686bd6 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.380018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a61b-c962-4c76-bb80-826433686bd6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.380297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a61b-c962-4c76-bb80-826433686bd6 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.381509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 215/441] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:11.386664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264a61b-c962-4c76-bb80-826433686bd6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:11.469519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ec966-15fb-4acf-b3a1-63c047a328d2 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.502757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264a61b-c962-4c76-bb80-826433686bd6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.505170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950d2e3-09c2-4e38-b8e2-0c87964f031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:11.506142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950d2e3-09c2-4e38-b8e2-0c87964f031e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.506487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950d2e3-09c2-4e38-b8e2-0c87964f031e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.506823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950d2e3-09c2-4e38-b8e2-0c87964f031e None admin] PATH_INFO: `/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.508360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950d2e3-09c2-4e38-b8e2-0c87964f031e None admin] RBAC: Authorizing `identity:get_project(project_id=42b621529bfd4baeb56fe9e133ee6b7c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:11.510174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950d2e3-09c2-4e38-b8e2-0c87964f031e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:11.517042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 227/442] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:11 2022] GET /identity/v3/projects/42b621529bfd4baeb56fe9e133ee6b7c => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:11.517042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1189704-ae16-4de2-b4ed-8fce3311e3c9 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.517042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1189704-ae16-4de2-b4ed-8fce3311e3c9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.517042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1189704-ae16-4de2-b4ed-8fce3311e3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.532571 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e1189704-ae16-4de2-b4ed-8fce3311e3c9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:11.533839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e1189704-ae16-4de2-b4ed-8fce3311e3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:11.543464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32f64-65d9-441e-a7d6-e5ca01d201cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:11.544127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32f64-65d9-441e-a7d6-e5ca01d201cf None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.544408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32f64-65d9-441e-a7d6-e5ca01d201cf None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.545368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa32f64-65d9-441e-a7d6-e5ca01d201cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.607979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 228/443] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:11.609160 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1189704-ae16-4de2-b4ed-8fce3311e3c9 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:11.631926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa32f64-65d9-441e-a7d6-e5ca01d201cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:11.633336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa32f64-65d9-441e-a7d6-e5ca01d201cf None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:11.707189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1189704-ae16-4de2-b4ed-8fce3311e3c9 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.727220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 216/444] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:11.728049 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32f64-65d9-441e-a7d6-e5ca01d201cf None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:11.740590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5003f-acd1-4456-84d5-34729895dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:11.741438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5003f-acd1-4456-84d5-34729895dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.741752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5003f-acd1-4456-84d5-34729895dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.742026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5003f-acd1-4456-84d5-34729895dbe5 None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.743188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5003f-acd1-4456-84d5-34729895dbe5 None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:11.744621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5003f-acd1-4456-84d5-34729895dbe5 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:11.746257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 229/445] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:11 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:11.747123 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5003f-acd1-4456-84d5-34729895dbe5 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:11.820846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa32f64-65d9-441e-a7d6-e5ca01d201cf None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.840686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5003f-acd1-4456-84d5-34729895dbe5 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.852727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108263-0b0a-4dae-b969-29e2e14c7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:11.853521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108263-0b0a-4dae-b969-29e2e14c7377 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.853831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108263-0b0a-4dae-b969-29e2e14c7377 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.854108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108263-0b0a-4dae-b969-29e2e14c7377 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.864628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c108263-0b0a-4dae-b969-29e2e14c7377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:11.871529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-6c108263-0b0a-4dae-b969-29e2e14c7377 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:41:11.874015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 217/446] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:11.874137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d32857-1086-45c6-b73a-2ca0e4539c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:11.874354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108263-0b0a-4dae-b969-29e2e14c7377 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:11.878458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32857-1086-45c6-b73a-2ca0e4539c87 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:11.878703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32857-1086-45c6-b73a-2ca0e4539c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:11.879055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32857-1086-45c6-b73a-2ca0e4539c87 None admin] PATH_INFO: `/v3/projects/427007497a734b6ab72d65a07f3dcbb7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:11.880915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d32857-1086-45c6-b73a-2ca0e4539c87 None admin] RBAC: Authorizing `identity:get_project(project_id=427007497a734b6ab72d65a07f3dcbb7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:11.883202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d32857-1086-45c6-b73a-2ca0e4539c87 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:11.885555 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 230/447] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:11 2022] GET /identity/v3/projects/427007497a734b6ab72d65a07f3dcbb7 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:11.886209 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d32857-1086-45c6-b73a-2ca0e4539c87 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:11.973590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108263-0b0a-4dae-b969-29e2e14c7377 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:11.979068 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d32857-1086-45c6-b73a-2ca0e4539c87 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:12.006227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa922803-fe36-4f9f-a5ec-c3273536a439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:12.006871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa922803-fe36-4f9f-a5ec-c3273536a439 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:12.007154 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa922803-fe36-4f9f-a5ec-c3273536a439 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:12.007432 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa922803-fe36-4f9f-a5ec-c3273536a439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:12.008266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa922803-fe36-4f9f-a5ec-c3273536a439 None admin] RBAC: Adding query filter params (group.id=2d6fbab3cb394bddbf30de888599eff7, role.id=82e7000d778e4c66a98f07a93e8ae084, scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:12.008581 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa922803-fe36-4f9f-a5ec-c3273536a439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:12.010082 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa922803-fe36-4f9f-a5ec-c3273536a439 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:12.010902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed0b87-ac85-45e9-8ee0-8caa6562b2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:12.011562 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed0b87-ac85-45e9-8ee0-8caa6562b2eb None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:12.011840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed0b87-ac85-45e9-8ee0-8caa6562b2eb None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:12.012111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed0b87-ac85-45e9-8ee0-8caa6562b2eb None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:12.012842 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed0b87-ac85-45e9-8ee0-8caa6562b2eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:12.013144 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed0b87-ac85-45e9-8ee0-8caa6562b2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:12.014624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed0b87-ac85-45e9-8ee0-8caa6562b2eb None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:12.016096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 218/448] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Apr 6 12:41:11 2022] GET /identity/v3/role_assignments?group.id=2d6fbab3cb394bddbf30de888599eff7&scope.project.id=42b621529bfd4baeb56fe9e133ee6b7c&role.id=82e7000d778e4c66a98f07a93e8ae084 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:12.016911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa922803-fe36-4f9f-a5ec-c3273536a439 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:12.025307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 231/449] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:12.031973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed0b87-ac85-45e9-8ee0-8caa6562b2eb None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:12.130263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa922803-fe36-4f9f-a5ec-c3273536a439 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:12.156652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed0b87-ac85-45e9-8ee0-8caa6562b2eb None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:12.165940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd048801-32be-481d-9be5-60bfb5e562f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:12.166820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd048801-32be-481d-9be5-60bfb5e562f5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:12.167110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd048801-32be-481d-9be5-60bfb5e562f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:12.167385 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd048801-32be-481d-9be5-60bfb5e562f5 None admin] PATH_INFO: `/v3/groups/2d6fbab3cb394bddbf30de888599eff7` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:12.168661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd048801-32be-481d-9be5-60bfb5e562f5 None admin] RBAC: Authorizing `identity:get_group(group_id=2d6fbab3cb394bddbf30de888599eff7)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:12.171523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd048801-32be-481d-9be5-60bfb5e562f5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:12.173252 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 219/450] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:12 2022] GET /identity/v3/groups/2d6fbab3cb394bddbf30de888599eff7 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:12.179423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd048801-32be-481d-9be5-60bfb5e562f5 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:12.194581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e32c0-5177-4ed9-8118-e56699792ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:12.195236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e32c0-5177-4ed9-8118-e56699792ebe None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:12.195514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e32c0-5177-4ed9-8118-e56699792ebe None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:12.195786 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e32c0-5177-4ed9-8118-e56699792ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:12.270589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e32c0-5177-4ed9-8118-e56699792ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:12.272051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e32c0-5177-4ed9-8118-e56699792ebe None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:12.290050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd048801-32be-481d-9be5-60bfb5e562f5 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:12.331140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebca06c-8603-4f90-9b0a-77d27106d880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:12.331807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebca06c-8603-4f90-9b0a-77d27106d880 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:12.332088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebca06c-8603-4f90-9b0a-77d27106d880 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:12.332361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebca06c-8603-4f90-9b0a-77d27106d880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:12.333194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebca06c-8603-4f90-9b0a-77d27106d880 None admin] RBAC: Adding query filter params (group.id=2d6fbab3cb394bddbf30de888599eff7, role.id=82e7000d778e4c66a98f07a93e8ae084, scope.project.id=427007497a734b6ab72d65a07f3dcbb7) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:12.333925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebca06c-8603-4f90-9b0a-77d27106d880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:12.334981 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebca06c-8603-4f90-9b0a-77d27106d880 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:12.341099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 220/451] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Apr 6 12:41:12 2022] GET /identity/v3/role_assignments?group.id=2d6fbab3cb394bddbf30de888599eff7&scope.project.id=427007497a734b6ab72d65a07f3dcbb7&role.id=82e7000d778e4c66a98f07a93e8ae084 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:12.395841 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 232/452] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 12:41:12.401894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebca06c-8603-4f90-9b0a-77d27106d880 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:12.518315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebca06c-8603-4f90-9b0a-77d27106d880 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:12.556042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649082a5-6b45-4483-b667-365b16522662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:12.556956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649082a5-6b45-4483-b667-365b16522662 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:12.557286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649082a5-6b45-4483-b667-365b16522662 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:12.557666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649082a5-6b45-4483-b667-365b16522662 None admin] PATH_INFO: `/v3/projects/0ae146b1346144a8a304973b35877975` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:12.558959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649082a5-6b45-4483-b667-365b16522662 None admin] RBAC: Authorizing `identity:get_project(project_id=0ae146b1346144a8a304973b35877975)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:12.560814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649082a5-6b45-4483-b667-365b16522662 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:12.563150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 221/453] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:41:12 2022] GET /identity/v3/projects/0ae146b1346144a8a304973b35877975 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:12.569051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e32c0-5177-4ed9-8118-e56699792ebe None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:12.678728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e32c0-5177-4ed9-8118-e56699792ebe None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:12.713820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6505f-744e-47c3-a421-00b7101935be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:12.714672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6505f-744e-47c3-a421-00b7101935be None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:12.714952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6505f-744e-47c3-a421-00b7101935be None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:12.715224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6505f-744e-47c3-a421-00b7101935be None admin] PATH_INFO: `/v3/groups/b4bebe0aa83d4c128349222a887a9dbc` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:12.716411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6505f-744e-47c3-a421-00b7101935be None admin] RBAC: Authorizing `identity:get_group(group_id=b4bebe0aa83d4c128349222a887a9dbc)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:12.717919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6505f-744e-47c3-a421-00b7101935be None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:12.719545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 233/454] 10.222.0.23 () {56 vars in 1180 bytes} [Wed Apr 6 12:41:12 2022] GET /identity/v3/groups/b4bebe0aa83d4c128349222a887a9dbc => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:12.725508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649082a5-6b45-4483-b667-365b16522662 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:12.826032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649082a5-6b45-4483-b667-365b16522662 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:12.856909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9cb949-94f0-4277-976a-837f65de1e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:12.857736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb949-94f0-4277-976a-837f65de1e66 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:12.857920 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb949-94f0-4277-976a-837f65de1e66 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:12.858225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9cb949-94f0-4277-976a-837f65de1e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:12.859051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cb949-94f0-4277-976a-837f65de1e66 None admin] RBAC: Adding query filter params (group.id=b4bebe0aa83d4c128349222a887a9dbc, role.id=c158bb1781c44a03890992161076b84b, scope.project.id=0ae146b1346144a8a304973b35877975) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:12.859376 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cb949-94f0-4277-976a-837f65de1e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:12.860808 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9cb949-94f0-4277-976a-837f65de1e66 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:12.866443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 222/455] 10.222.0.23 () {56 vars in 1376 bytes} [Wed Apr 6 12:41:12 2022] GET /identity/v3/role_assignments?group.id=b4bebe0aa83d4c128349222a887a9dbc&scope.project.id=0ae146b1346144a8a304973b35877975&role.id=c158bb1781c44a03890992161076b84b => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:16.088494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf336-12c3-4947-bf34-0b71e94d1f3e None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.089181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf336-12c3-4947-bf34-0b71e94d1f3e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.089181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf336-12c3-4947-bf34-0b71e94d1f3e None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.090670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 234/456] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:16.096615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3c95-7e63-4852-9839-5833d2dcd768 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.097843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3c95-7e63-4852-9839-5833d2dcd768 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.098531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d3c95-7e63-4852-9839-5833d2dcd768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.122519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d672b-552f-4960-a1b9-42725412c50a None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.123482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d672b-552f-4960-a1b9-42725412c50a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.123712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061d672b-552f-4960-a1b9-42725412c50a None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.125329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 235/457] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:41:16.131543 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-664d3c95-7e63-4852-9839-5833d2dcd768 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:16.132751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-664d3c95-7e63-4852-9839-5833d2dcd768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:16.151629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764551c-78fd-4c11-9b78-6b17bc9c7503 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.152009 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764551c-78fd-4c11-9b78-6b17bc9c7503 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.152218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764551c-78fd-4c11-9b78-6b17bc9c7503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.182580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2764551c-78fd-4c11-9b78-6b17bc9c7503 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:16.183775 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2764551c-78fd-4c11-9b78-6b17bc9c7503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:16.212127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 223/458] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:16.237999 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d3c95-7e63-4852-9839-5833d2dcd768 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:16.291430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 236/459] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:16.391878 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764551c-78fd-4c11-9b78-6b17bc9c7503 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:16.422051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d3c95-7e63-4852-9839-5833d2dcd768 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:16.474181 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2085d0-b240-4c62-a8e8-3dcedf7998e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:16.475389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2085d0-b240-4c62-a8e8-3dcedf7998e5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.475823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2085d0-b240-4c62-a8e8-3dcedf7998e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.476232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2085d0-b240-4c62-a8e8-3dcedf7998e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.491804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2085d0-b240-4c62-a8e8-3dcedf7998e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:16.494250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2085d0-b240-4c62-a8e8-3dcedf7998e5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:16.523228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-3f2085d0-b240-4c62-a8e8-3dcedf7998e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:16.525735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 224/460] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:16.527870 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603cdb-a976-407c-8e1d-08913caed882 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.528480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603cdb-a976-407c-8e1d-08913caed882 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.529186 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603cdb-a976-407c-8e1d-08913caed882 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.529980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764551c-78fd-4c11-9b78-6b17bc9c7503 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:16.531804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 225/461] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:16.533168 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603cdb-a976-407c-8e1d-08913caed882 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:16.570286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b408f0e-9774-4a5a-bb77-0b9b501285b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:16.571519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b408f0e-9774-4a5a-bb77-0b9b501285b7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.571997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b408f0e-9774-4a5a-bb77-0b9b501285b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.572414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b408f0e-9774-4a5a-bb77-0b9b501285b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.583475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b408f0e-9774-4a5a-bb77-0b9b501285b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:16.585614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b408f0e-9774-4a5a-bb77-0b9b501285b7 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:16.604119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-7b408f0e-9774-4a5a-bb77-0b9b501285b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:16.611192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 237/462] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:16.612745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c633-ec34-4606-b693-09d347a2ecb3 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.613181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c633-ec34-4606-b693-09d347a2ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.613661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c633-ec34-4606-b693-09d347a2ecb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.631318 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-1815c633-ec34-4606-b693-09d347a2ecb3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:16.632779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1815c633-ec34-4606-b693-09d347a2ecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:16.667972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603cdb-a976-407c-8e1d-08913caed882 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:16.703636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 238/463] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:16.703837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09e28d-33ea-4402-b93f-ebe109d10fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:16.704387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09e28d-33ea-4402-b93f-ebe109d10fb5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.704669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09e28d-33ea-4402-b93f-ebe109d10fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.704944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09e28d-33ea-4402-b93f-ebe109d10fb5 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.705306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c633-ec34-4606-b693-09d347a2ecb3 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:16.705708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09e28d-33ea-4402-b93f-ebe109d10fb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:16.706021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09e28d-33ea-4402-b93f-ebe109d10fb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:16.707430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09e28d-33ea-4402-b93f-ebe109d10fb5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:16.720132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 226/464] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:16.721705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f7af-04b5-4881-b123-9ea0ff5071a9 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.722143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f7af-04b5-4881-b123-9ea0ff5071a9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.722587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58f7af-04b5-4881-b123-9ea0ff5071a9 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.724319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 227/465] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:16.730919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d72d0-7f0e-4f54-8c2a-5ce2ad8997c7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.731203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d72d0-7f0e-4f54-8c2a-5ce2ad8997c7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.731489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d72d0-7f0e-4f54-8c2a-5ce2ad8997c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.750297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-bc2d72d0-7f0e-4f54-8c2a-5ce2ad8997c7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:16.751498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bc2d72d0-7f0e-4f54-8c2a-5ce2ad8997c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:16.816726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c633-ec34-4606-b693-09d347a2ecb3 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:16.821711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 228/466] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:16.822801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d72d0-7f0e-4f54-8c2a-5ce2ad8997c7 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:16.851637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7725f4-26ad-49aa-92f1-518d49021ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:16.852310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7725f4-26ad-49aa-92f1-518d49021ff5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.852596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7725f4-26ad-49aa-92f1-518d49021ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.852872 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7725f4-26ad-49aa-92f1-518d49021ff5 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.853641 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7725f4-26ad-49aa-92f1-518d49021ff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:16.853934 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7725f4-26ad-49aa-92f1-518d49021ff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:16.855314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7725f4-26ad-49aa-92f1-518d49021ff5 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:16.875406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 239/467] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:16.876879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7725f4-26ad-49aa-92f1-518d49021ff5 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:16.932651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d72d0-7f0e-4f54-8c2a-5ce2ad8997c7 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:16.967488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce492fd-2878-4f4f-ba48-913b5d698360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:16.968142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce492fd-2878-4f4f-ba48-913b5d698360 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:16.968427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce492fd-2878-4f4f-ba48-913b5d698360 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:16.968699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce492fd-2878-4f4f-ba48-913b5d698360 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:16.969408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce492fd-2878-4f4f-ba48-913b5d698360 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:16.970928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce492fd-2878-4f4f-ba48-913b5d698360 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:16.993386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 229/468] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:41:16 2022] POST /identity/v3/users => generated 248 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:41:16.994392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7725f4-26ad-49aa-92f1-518d49021ff5 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:16.994594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce492fd-2878-4f4f-ba48-913b5d698360 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:17.051207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4a027-1d0c-4f7e-ae06-c4e3424a72c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:17.052162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4a027-1d0c-4f7e-ae06-c4e3424a72c4 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:17.052449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4a027-1d0c-4f7e-ae06-c4e3424a72c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:17.052698 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4a027-1d0c-4f7e-ae06-c4e3424a72c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:17.067118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4a027-1d0c-4f7e-ae06-c4e3424a72c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:17.069218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4a027-1d0c-4f7e-ae06-c4e3424a72c4 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:17.094176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-e8d4a027-1d0c-4f7e-ae06-c4e3424a72c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:17.100305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 240/469] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:17.100305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4a027-1d0c-4f7e-ae06-c4e3424a72c4 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:17.133859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce492fd-2878-4f4f-ba48-913b5d698360 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:17.171871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940b59a-d783-426c-b4c9-b981e7b442fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:17.173124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940b59a-d783-426c-b4c9-b981e7b442fa None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:17.173645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940b59a-d783-426c-b4c9-b981e7b442fa None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:17.174129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940b59a-d783-426c-b4c9-b981e7b442fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:17.187781 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940b59a-d783-426c-b4c9-b981e7b442fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:17.189836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940b59a-d783-426c-b4c9-b981e7b442fa None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:17.208301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4a027-1d0c-4f7e-ae06-c4e3424a72c4 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:17.209757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-7940b59a-d783-426c-b4c9-b981e7b442fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:17.211623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 230/470] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:17.212708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940b59a-d783-426c-b4c9-b981e7b442fa None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:17.243393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176039-bc2e-4a31-9ac1-971ffb5b081b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:17.244073 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176039-bc2e-4a31-9ac1-971ffb5b081b None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:17.244355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176039-bc2e-4a31-9ac1-971ffb5b081b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:17.244629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98176039-bc2e-4a31-9ac1-971ffb5b081b None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:17.245358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176039-bc2e-4a31-9ac1-971ffb5b081b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:17.248357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98176039-bc2e-4a31-9ac1-971ffb5b081b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:17.278007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 241/471] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:41:17 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:41:17.279313 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176039-bc2e-4a31-9ac1-971ffb5b081b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:17.359290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940b59a-d783-426c-b4c9-b981e7b442fa None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:17.408722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63925a-f418-4216-93be-1c139fd6fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:17.409424 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63925a-f418-4216-93be-1c139fd6fb97 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:17.409755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63925a-f418-4216-93be-1c139fd6fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:17.410038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63925a-f418-4216-93be-1c139fd6fb97 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:17.410792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63925a-f418-4216-93be-1c139fd6fb97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:17.411106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63925a-f418-4216-93be-1c139fd6fb97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:17.413286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63925a-f418-4216-93be-1c139fd6fb97 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:17.430522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 231/472] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:17.432086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054df7-c9dc-4b4e-bfec-9d3870ce5fd7 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:17.432375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054df7-c9dc-4b4e-bfec-9d3870ce5fd7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:17.432656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67054df7-c9dc-4b4e-bfec-9d3870ce5fd7 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:17.434002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98176039-bc2e-4a31-9ac1-971ffb5b081b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:17.440500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 232/473] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:17.442040 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67054df7-c9dc-4b4e-bfec-9d3870ce5fd7 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:17.480383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b08500-53cc-4993-a403-140f59a37e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:17.481206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08500-53cc-4993-a403-140f59a37e9b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:17.481499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08500-53cc-4993-a403-140f59a37e9b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:17.481810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b08500-53cc-4993-a403-140f59a37e9b None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:17.483280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b08500-53cc-4993-a403-140f59a37e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:17.483603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b08500-53cc-4993-a403-140f59a37e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:17.485170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b08500-53cc-4993-a403-140f59a37e9b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:17.500188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 242/474] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:17.501549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf605b14-14b6-4714-acb5-ac2b173a95eb None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:17.501863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf605b14-14b6-4714-acb5-ac2b173a95eb None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:17.502272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf605b14-14b6-4714-acb5-ac2b173a95eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:17.521099 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-bf605b14-14b6-4714-acb5-ac2b173a95eb None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:17.522321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bf605b14-14b6-4714-acb5-ac2b173a95eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:17.595881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67054df7-c9dc-4b4e-bfec-9d3870ce5fd7 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:17.630786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c631b41-c1d1-4fb9-9a31-75c5e069552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:17.631470 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c631b41-c1d1-4fb9-9a31-75c5e069552e None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:17.631766 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c631b41-c1d1-4fb9-9a31-75c5e069552e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:17.632043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c631b41-c1d1-4fb9-9a31-75c5e069552e None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:17.632763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c631b41-c1d1-4fb9-9a31-75c5e069552e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:17.634327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c631b41-c1d1-4fb9-9a31-75c5e069552e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:17.641412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 243/475] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:17.647151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf605b14-14b6-4714-acb5-ac2b173a95eb None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:17.670447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 233/476] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:41:17 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:41:17.691064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c631b41-c1d1-4fb9-9a31-75c5e069552e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:17.828643 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c631b41-c1d1-4fb9-9a31-75c5e069552e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:17.911666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45e5f1-107f-4140-b7d7-d544901c6dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:17.912654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45e5f1-107f-4140-b7d7-d544901c6dff None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:17.913111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45e5f1-107f-4140-b7d7-d544901c6dff None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:17.913606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45e5f1-107f-4140-b7d7-d544901c6dff None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:17.914549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45e5f1-107f-4140-b7d7-d544901c6dff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:17.916144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45e5f1-107f-4140-b7d7-d544901c6dff None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:17.922747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf605b14-14b6-4714-acb5-ac2b173a95eb None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:17.926839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.sql.core [None req-bd45e5f1-107f-4140-b7d7-d544901c6dff None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 06 12:41:17.926839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 06 12:41:17.926839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [parameters: {'id': '0f184c9a5bc74166b311a1f429bb8045', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 06 12:41:17.926839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86176) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 06 12:41:17.952280 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-bd45e5f1-107f-4140-b7d7-d544901c6dff None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 06 12:41:17.957980 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 234/477] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Apr 6 12:41:17 2022] POST /identity/v3/roles => generated 144 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:17.965647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45e5f1-107f-4140-b7d7-d544901c6dff None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:17.984394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc61a8b-bd61-463e-9431-94517ad5cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:17.985433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61a8b-bd61-463e-9431-94517ad5cea8 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:17.985976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61a8b-bd61-463e-9431-94517ad5cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:17.986436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc61a8b-bd61-463e-9431-94517ad5cea8 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:17.987354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc61a8b-bd61-463e-9431-94517ad5cea8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:17.988975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc61a8b-bd61-463e-9431-94517ad5cea8 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:18.012136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 244/478] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:41:17 2022] POST /identity/v3/users => generated 249 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:41:18.140333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45e5f1-107f-4140-b7d7-d544901c6dff None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:18.178536 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61eb932-ef0a-4fd8-807b-eca0a0f5c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:18.179366 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eb932-ef0a-4fd8-807b-eca0a0f5c84c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:18.179650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eb932-ef0a-4fd8-807b-eca0a0f5c84c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:18.179927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61eb932-ef0a-4fd8-807b-eca0a0f5c84c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:18.192066 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61eb932-ef0a-4fd8-807b-eca0a0f5c84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:18.199786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-e61eb932-ef0a-4fd8-807b-eca0a0f5c84c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 06 12:41:18.201476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 235/479] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:41:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:18.210864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc61a8b-bd61-463e-9431-94517ad5cea8 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:18.323403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc61a8b-bd61-463e-9431-94517ad5cea8 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:18.359797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069ab61-daf0-4c12-ab11-2e8e6d5cdd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:18.360527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ab61-daf0-4c12-ab11-2e8e6d5cdd24 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:18.360818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ab61-daf0-4c12-ab11-2e8e6d5cdd24 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:18.361098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ab61-daf0-4c12-ab11-2e8e6d5cdd24 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:18.361889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069ab61-daf0-4c12-ab11-2e8e6d5cdd24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:18.362201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069ab61-daf0-4c12-ab11-2e8e6d5cdd24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:18.363629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069ab61-daf0-4c12-ab11-2e8e6d5cdd24 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:18.372322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 245/480] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:19.978305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce54f-69b6-4ef4-aebc-aecf2d0763a8 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:19.978994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce54f-69b6-4ef4-aebc-aecf2d0763a8 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:19.978994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcce54f-69b6-4ef4-aebc-aecf2d0763a8 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:19.980517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 236/481] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:19.987925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa547-7489-4857-9a3b-5c86415740c2 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:19.988553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa547-7489-4857-9a3b-5c86415740c2 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:19.988553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa547-7489-4857-9a3b-5c86415740c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:20.010575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b3afa547-7489-4857-9a3b-5c86415740c2 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:20.011802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b3afa547-7489-4857-9a3b-5c86415740c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:20.097505 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 246/482] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:20.157780 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcce54f-69b6-4ef4-aebc-aecf2d0763a8 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:20.215135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e23dd-ed34-4651-9454-b86f7db2fed9 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:20.215542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e23dd-ed34-4651-9454-b86f7db2fed9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:20.215789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e23dd-ed34-4651-9454-b86f7db2fed9 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:20.219084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 247/483] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:41:20.223171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6379c-e801-4f61-91cd-9a02eaf64d43 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:20.223447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6379c-e801-4f61-91cd-9a02eaf64d43 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:20.223729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6379c-e801-4f61-91cd-9a02eaf64d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:20.241487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-13a6379c-e801-4f61-91cd-9a02eaf64d43 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:20.242647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-13a6379c-e801-4f61-91cd-9a02eaf64d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:20.295574 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcce54f-69b6-4ef4-aebc-aecf2d0763a8 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:20.317686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 248/484] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:20.337653 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6379c-e801-4f61-91cd-9a02eaf64d43 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:20.358320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb0b1a-77b8-4470-a96e-9dc3549b6c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:20.359141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb0b1a-77b8-4470-a96e-9dc3549b6c2a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:20.359436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb0b1a-77b8-4470-a96e-9dc3549b6c2a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:20.359724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb0b1a-77b8-4470-a96e-9dc3549b6c2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:20.373672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb0b1a-77b8-4470-a96e-9dc3549b6c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:20.381196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-b6fb0b1a-77b8-4470-a96e-9dc3549b6c2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:20.382923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 237/485] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:20.390458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb0b1a-77b8-4470-a96e-9dc3549b6c2a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:20.440051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6379c-e801-4f61-91cd-9a02eaf64d43 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:20.473974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99157a-d028-4f26-bc6c-441f435afff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:20.475041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99157a-d028-4f26-bc6c-441f435afff4 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:20.475465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99157a-d028-4f26-bc6c-441f435afff4 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:20.475875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99157a-d028-4f26-bc6c-441f435afff4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:20.487296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99157a-d028-4f26-bc6c-441f435afff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:20.494587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-8d99157a-d028-4f26-bc6c-441f435afff4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:20.500891 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 249/486] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:20.502331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99157a-d028-4f26-bc6c-441f435afff4 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:20.505355 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb0b1a-77b8-4470-a96e-9dc3549b6c2a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:20.568634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c59bf9-7af2-4e6e-89cc-7bf875cb2cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:20.569362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c59bf9-7af2-4e6e-89cc-7bf875cb2cdb None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:20.569830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c59bf9-7af2-4e6e-89cc-7bf875cb2cdb None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:20.570256 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c59bf9-7af2-4e6e-89cc-7bf875cb2cdb None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:20.571192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c59bf9-7af2-4e6e-89cc-7bf875cb2cdb None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:20.571735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c59bf9-7af2-4e6e-89cc-7bf875cb2cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:20.573417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c59bf9-7af2-4e6e-89cc-7bf875cb2cdb None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:20.590046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 238/487] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:20.597944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c59bf9-7af2-4e6e-89cc-7bf875cb2cdb None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:20.604935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99157a-d028-4f26-bc6c-441f435afff4 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:20.642610 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1aad8-63b8-467a-886c-81df51887e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:20.645548 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1aad8-63b8-467a-886c-81df51887e21 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:20.646697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1aad8-63b8-467a-886c-81df51887e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:20.649023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1aad8-63b8-467a-886c-81df51887e21 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:20.650817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1aad8-63b8-467a-886c-81df51887e21 None admin] RBAC: Adding query filter params (name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:20.651862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1aad8-63b8-467a-886c-81df51887e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:20.655067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1aad8-63b8-467a-886c-81df51887e21 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:20.685889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 250/488] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:20.692360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1aad8-63b8-467a-886c-81df51887e21 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:20.737147 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c59bf9-7af2-4e6e-89cc-7bf875cb2cdb None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:20.772850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e972d-21a4-41ae-be5a-325f48aefe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:20.774000 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e972d-21a4-41ae-be5a-325f48aefe3e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:20.774428 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e972d-21a4-41ae-be5a-325f48aefe3e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:20.774850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e972d-21a4-41ae-be5a-325f48aefe3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:20.787503 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e972d-21a4-41ae-be5a-325f48aefe3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:20.789272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e972d-21a4-41ae-be5a-325f48aefe3e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:20.807322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-a68e972d-21a4-41ae-be5a-325f48aefe3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:20.809069 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 239/489] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:20.818214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e972d-21a4-41ae-be5a-325f48aefe3e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:20.922213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e972d-21a4-41ae-be5a-325f48aefe3e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:20.958074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11c7e0-11a2-4b5a-901f-aa9be1611d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:20.959116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11c7e0-11a2-4b5a-901f-aa9be1611d82 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:20.959638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11c7e0-11a2-4b5a-901f-aa9be1611d82 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:20.960112 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11c7e0-11a2-4b5a-901f-aa9be1611d82 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:20.961037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11c7e0-11a2-4b5a-901f-aa9be1611d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:20.961543 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11c7e0-11a2-4b5a-901f-aa9be1611d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:20.963313 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11c7e0-11a2-4b5a-901f-aa9be1611d82 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:20.972933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1aad8-63b8-467a-886c-81df51887e21 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:20.977891 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 240/490] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:20.985919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11c7e0-11a2-4b5a-901f-aa9be1611d82 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:21.046959 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930bea3-b782-4de0-bd29-e05e75911e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:21.047690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930bea3-b782-4de0-bd29-e05e75911e76 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.047979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930bea3-b782-4de0-bd29-e05e75911e76 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.048257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930bea3-b782-4de0-bd29-e05e75911e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.072745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930bea3-b782-4de0-bd29-e05e75911e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:21.074261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930bea3-b782-4de0-bd29-e05e75911e76 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:21.093587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11c7e0-11a2-4b5a-901f-aa9be1611d82 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:21.102705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-9930bea3-b782-4de0-bd29-e05e75911e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:21.113695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 251/491] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:21.114654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930bea3-b782-4de0-bd29-e05e75911e76 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:21.130560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee5ca4-8768-400e-94b0-5036e6322994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:21.131812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee5ca4-8768-400e-94b0-5036e6322994 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.132299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee5ca4-8768-400e-94b0-5036e6322994 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.132822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee5ca4-8768-400e-94b0-5036e6322994 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.140959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee5ca4-8768-400e-94b0-5036e6322994 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:21.142819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee5ca4-8768-400e-94b0-5036e6322994 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:21.158514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-52ee5ca4-8768-400e-94b0-5036e6322994 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 06 12:41:21.160489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 241/492] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:21.170949 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee5ca4-8768-400e-94b0-5036e6322994 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:21.239739 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930bea3-b782-4de0-bd29-e05e75911e76 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:21.279611 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d07837-2037-4c13-af03-7405d3b7266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:21.280609 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07837-2037-4c13-af03-7405d3b7266a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.281141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07837-2037-4c13-af03-7405d3b7266a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.281421 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07837-2037-4c13-af03-7405d3b7266a None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.282353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d07837-2037-4c13-af03-7405d3b7266a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:21.282662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d07837-2037-4c13-af03-7405d3b7266a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:21.284707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d07837-2037-4c13-af03-7405d3b7266a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:21.288814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee5ca4-8768-400e-94b0-5036e6322994 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:21.302601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 252/493] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:21.304012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dfc0f-3980-4360-85d2-1a56c814fb72 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.304298 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dfc0f-3980-4360-85d2-1a56c814fb72 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.304569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dfc0f-3980-4360-85d2-1a56c814fb72 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.306000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 253/494] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:21.308981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dfc0f-3980-4360-85d2-1a56c814fb72 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:21.337859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c63c4-a1a9-4068-844f-2c3dbdeb384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:21.338646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c63c4-a1a9-4068-844f-2c3dbdeb384a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.339179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c63c4-a1a9-4068-844f-2c3dbdeb384a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.339569 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c63c4-a1a9-4068-844f-2c3dbdeb384a None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.341038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c63c4-a1a9-4068-844f-2c3dbdeb384a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:21.342049 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c63c4-a1a9-4068-844f-2c3dbdeb384a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:21.343858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c63c4-a1a9-4068-844f-2c3dbdeb384a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:21.393699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 242/495] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Apr 6 12:41:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:21.399149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c3454-30cd-4360-9646-a1f3cdf919f1 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.399760 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c3454-30cd-4360-9646-a1f3cdf919f1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.400569 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c3454-30cd-4360-9646-a1f3cdf919f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.421929 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-201c3454-30cd-4360-9646-a1f3cdf919f1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:21.423862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-201c3454-30cd-4360-9646-a1f3cdf919f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:21.440288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dfc0f-3980-4360-85d2-1a56c814fb72 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:21.474866 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83e13-2702-453f-999d-d499479736df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:21.475943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83e13-2702-453f-999d-d499479736df None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.476391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83e13-2702-453f-999d-d499479736df None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.476803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83e13-2702-453f-999d-d499479736df None admin] PATH_INFO: `/v3/users/nova` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.485222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e83e13-2702-453f-999d-d499479736df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:21.486931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e83e13-2702-453f-999d-d499479736df None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:21.502722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-38e83e13-2702-453f-999d-d499479736df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 12:41:21.504434 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 254/496] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Apr 6 12:41:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:21.505447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83e13-2702-453f-999d-d499479736df None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:21.512723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 243/497] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:21.513953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c3454-30cd-4360-9646-a1f3cdf919f1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:21.636194 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83e13-2702-453f-999d-d499479736df None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:21.639792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c3454-30cd-4360-9646-a1f3cdf919f1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:21.674864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6a5e0-5465-470e-ac07-e79a332a988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:21.676038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a5e0-5465-470e-ac07-e79a332a988a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.676475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a5e0-5465-470e-ac07-e79a332a988a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.676883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6a5e0-5465-470e-ac07-e79a332a988a None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.677902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6a5e0-5465-470e-ac07-e79a332a988a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:21.678365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6a5e0-5465-470e-ac07-e79a332a988a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:21.679119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65ffa7-3367-4c26-aeea-c6f61f502f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:21.680013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6a5e0-5465-470e-ac07-e79a332a988a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:21.680124 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65ffa7-3367-4c26-aeea-c6f61f502f39 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.680605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65ffa7-3367-4c26-aeea-c6f61f502f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.681079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65ffa7-3367-4c26-aeea-c6f61f502f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.706110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 244/498] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Apr 6 12:41:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:21.706110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6a5e0-5465-470e-ac07-e79a332a988a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:21.758777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65ffa7-3367-4c26-aeea-c6f61f502f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:21.760228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65ffa7-3367-4c26-aeea-c6f61f502f39 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:21.800855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6a5e0-5465-470e-ac07-e79a332a988a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:21.836153 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00372190-acf7-4d7a-b472-2b8cb36d9bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:21.836993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00372190-acf7-4d7a-b472-2b8cb36d9bf9 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.837443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00372190-acf7-4d7a-b472-2b8cb36d9bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.837905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00372190-acf7-4d7a-b472-2b8cb36d9bf9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.848240 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00372190-acf7-4d7a-b472-2b8cb36d9bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:21.855626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-00372190-acf7-4d7a-b472-2b8cb36d9bf9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:21.857173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 245/499] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:21.858601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b0bf-84b3-4bee-be53-56ddc669ac96 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.858709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 255/500] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:21.859129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b0bf-84b3-4bee-be53-56ddc669ac96 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.859539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65ffa7-3367-4c26-aeea-c6f61f502f39 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:21.859640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10b0bf-84b3-4bee-be53-56ddc669ac96 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.861040 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 246/501] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:21.863967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b0bf-84b3-4bee-be53-56ddc669ac96 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:21.961691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65ffa7-3367-4c26-aeea-c6f61f502f39 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:21.964601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10b0bf-84b3-4bee-be53-56ddc669ac96 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:21.994396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b64e1-932f-4a68-9222-578a9423cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:21.995041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b64e1-932f-4a68-9222-578a9423cb45 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.995357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b64e1-932f-4a68-9222-578a9423cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:21.995638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b64e1-932f-4a68-9222-578a9423cb45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:21.997965 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c3dda-09e6-4f26-8bbd-0c19fb96c791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:21.999198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c3dda-09e6-4f26-8bbd-0c19fb96c791 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:21.999692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c3dda-09e6-4f26-8bbd-0c19fb96c791 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.000227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c3dda-09e6-4f26-8bbd-0c19fb96c791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.011608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c3dda-09e6-4f26-8bbd-0c19fb96c791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:22.013697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c3dda-09e6-4f26-8bbd-0c19fb96c791 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:22.030396 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-934c3dda-09e6-4f26-8bbd-0c19fb96c791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:22.031596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 247/502] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:22.032792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93636c7d-b2d1-4671-8bea-ab601f7d9468 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.033063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93636c7d-b2d1-4671-8bea-ab601f7d9468 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.033402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93636c7d-b2d1-4671-8bea-ab601f7d9468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.050651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-93636c7d-b2d1-4671-8bea-ab601f7d9468 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:22.051814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-93636c7d-b2d1-4671-8bea-ab601f7d9468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:22.065333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b64e1-932f-4a68-9222-578a9423cb45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:22.066827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b64e1-932f-4a68-9222-578a9423cb45 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:22.117930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 248/503] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:22.118773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93636c7d-b2d1-4671-8bea-ab601f7d9468 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:22.179276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 256/504] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:22.180995 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137ec26-eb7f-4187-b8ce-83740fd47a11 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.181343 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137ec26-eb7f-4187-b8ce-83740fd47a11 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.181714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137ec26-eb7f-4187-b8ce-83740fd47a11 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.183030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 257/505] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:22.183858 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137ec26-eb7f-4187-b8ce-83740fd47a11 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:22.234944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93636c7d-b2d1-4671-8bea-ab601f7d9468 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:22.269366 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815a876-a835-43e6-8e03-edbf88e08f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:22.270178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815a876-a835-43e6-8e03-edbf88e08f02 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.270630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815a876-a835-43e6-8e03-edbf88e08f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.271043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815a876-a835-43e6-8e03-edbf88e08f02 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.271864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815a876-a835-43e6-8e03-edbf88e08f02 None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:22.272235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815a876-a835-43e6-8e03-edbf88e08f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:22.274017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815a876-a835-43e6-8e03-edbf88e08f02 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:22.284042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 249/506] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:22.284773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815a876-a835-43e6-8e03-edbf88e08f02 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:22.287912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137ec26-eb7f-4187-b8ce-83740fd47a11 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:22.323596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24768a07-31cf-40f6-8f45-c3d686c597af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:22.324503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24768a07-31cf-40f6-8f45-c3d686c597af None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.324893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24768a07-31cf-40f6-8f45-c3d686c597af None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.325298 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24768a07-31cf-40f6-8f45-c3d686c597af None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.327322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24768a07-31cf-40f6-8f45-c3d686c597af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:22.327788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24768a07-31cf-40f6-8f45-c3d686c597af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:22.329919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24768a07-31cf-40f6-8f45-c3d686c597af None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:22.344272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 258/507] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:22.345438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24768a07-31cf-40f6-8f45-c3d686c597af None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:22.386085 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815a876-a835-43e6-8e03-edbf88e08f02 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:22.420942 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2f032-38e6-490c-866b-bfea1f3f9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:22.421775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2f032-38e6-490c-866b-bfea1f3f9644 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.422052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2f032-38e6-490c-866b-bfea1f3f9644 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.422320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2f032-38e6-490c-866b-bfea1f3f9644 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.432458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2f032-38e6-490c-866b-bfea1f3f9644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:22.440325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-a8b2f032-38e6-490c-866b-bfea1f3f9644 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:22.441831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 250/508] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:22.442709 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c1aa9-0e4a-4902-93c1-ca489bb42cac None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.442990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c1aa9-0e4a-4902-93c1-ca489bb42cac None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.443269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c1aa9-0e4a-4902-93c1-ca489bb42cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.454487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24768a07-31cf-40f6-8f45-c3d686c597af None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:22.461063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e52c1aa9-0e4a-4902-93c1-ca489bb42cac None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:22.462314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e52c1aa9-0e4a-4902-93c1-ca489bb42cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:22.491723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19620649-24a9-40dd-87ff-68fcc5b9d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:22.492438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19620649-24a9-40dd-87ff-68fcc5b9d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.492715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19620649-24a9-40dd-87ff-68fcc5b9d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.492986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19620649-24a9-40dd-87ff-68fcc5b9d8c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.504229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19620649-24a9-40dd-87ff-68fcc5b9d8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:22.505712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19620649-24a9-40dd-87ff-68fcc5b9d8c1 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:22.523292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-19620649-24a9-40dd-87ff-68fcc5b9d8c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:22.524857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 259/509] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:22.526164 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19620649-24a9-40dd-87ff-68fcc5b9d8c1 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:22.533661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 251/510] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:22.533661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c1aa9-0e4a-4902-93c1-ca489bb42cac None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:22.651177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c1aa9-0e4a-4902-93c1-ca489bb42cac None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:22.659723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19620649-24a9-40dd-87ff-68fcc5b9d8c1 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:22.700179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395a058-43ca-4284-88fa-9df1f8d80e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:22.702005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395a058-43ca-4284-88fa-9df1f8d80e88 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.702433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395a058-43ca-4284-88fa-9df1f8d80e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.702864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395a058-43ca-4284-88fa-9df1f8d80e88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.709363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97dcf-87ba-4c2e-8a6f-8f7246b71dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:22.710651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97dcf-87ba-4c2e-8a6f-8f7246b71dc2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.711115 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97dcf-87ba-4c2e-8a6f-8f7246b71dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.711585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97dcf-87ba-4c2e-8a6f-8f7246b71dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.713551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395a058-43ca-4284-88fa-9df1f8d80e88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:22.716102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395a058-43ca-4284-88fa-9df1f8d80e88 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:22.728210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd97dcf-87ba-4c2e-8a6f-8f7246b71dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:22.730717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd97dcf-87ba-4c2e-8a6f-8f7246b71dc2 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:22.738084 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-e395a058-43ca-4284-88fa-9df1f8d80e88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:22.740120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 252/511] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:22.741286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395a058-43ca-4284-88fa-9df1f8d80e88 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:22.754012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-5dd97dcf-87ba-4c2e-8a6f-8f7246b71dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:22.755175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 260/512] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:22.755970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97dcf-87ba-4c2e-8a6f-8f7246b71dc2 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:22.872223 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395a058-43ca-4284-88fa-9df1f8d80e88 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:22.883365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97dcf-87ba-4c2e-8a6f-8f7246b71dc2 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:22.921327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac92924-1c65-44f6-b63f-499336d4e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:22.922329 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac92924-1c65-44f6-b63f-499336d4e68d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.922795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac92924-1c65-44f6-b63f-499336d4e68d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.923254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac92924-1c65-44f6-b63f-499336d4e68d None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.924546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac92924-1c65-44f6-b63f-499336d4e68d None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:22.925320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac92924-1c65-44f6-b63f-499336d4e68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:22.927709 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac92924-1c65-44f6-b63f-499336d4e68d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:22.933038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfaa29-cf6d-4590-8a6f-85d9a852535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:22.934106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfaa29-cf6d-4590-8a6f-85d9a852535b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:22.934567 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfaa29-cf6d-4590-8a6f-85d9a852535b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:22.935571 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bfaa29-cf6d-4590-8a6f-85d9a852535b None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:22.936614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfaa29-cf6d-4590-8a6f-85d9a852535b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:22.937137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfaa29-cf6d-4590-8a6f-85d9a852535b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:22.939538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bfaa29-cf6d-4590-8a6f-85d9a852535b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:22.940955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 253/513] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:22.942291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac92924-1c65-44f6-b63f-499336d4e68d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:22.957935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 261/514] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:22.959040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfaa29-cf6d-4590-8a6f-85d9a852535b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:23.070259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac92924-1c65-44f6-b63f-499336d4e68d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:23.080931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bfaa29-cf6d-4590-8a6f-85d9a852535b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:23.102567 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea301b69-0d12-4066-8d7f-e8dca13115bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:23.103355 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea301b69-0d12-4066-8d7f-e8dca13115bd None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:23.103647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea301b69-0d12-4066-8d7f-e8dca13115bd None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:23.103926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea301b69-0d12-4066-8d7f-e8dca13115bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:23.114843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aefda-811b-4c82-bb22-f4255e011b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:23.115104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea301b69-0d12-4066-8d7f-e8dca13115bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:23.115600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aefda-811b-4c82-bb22-f4255e011b21 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:23.115937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aefda-811b-4c82-bb22-f4255e011b21 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:23.116274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aefda-811b-4c82-bb22-f4255e011b21 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:23.116590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea301b69-0d12-4066-8d7f-e8dca13115bd None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:23.117170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aefda-811b-4c82-bb22-f4255e011b21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:23.117637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aefda-811b-4c82-bb22-f4255e011b21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:23.119429 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aefda-811b-4c82-bb22-f4255e011b21 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:23.133369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-ea301b69-0d12-4066-8d7f-e8dca13115bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:23.134597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 254/515] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:23.135373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea301b69-0d12-4066-8d7f-e8dca13115bd None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:23.144552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 262/516] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:23.144552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aefda-811b-4c82-bb22-f4255e011b21 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:23.233850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea301b69-0d12-4066-8d7f-e8dca13115bd None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:23.239851 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aefda-811b-4c82-bb22-f4255e011b21 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:23.267038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72fa67-8afd-4c8c-ae51-cfab3a5f4198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:23.267702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72fa67-8afd-4c8c-ae51-cfab3a5f4198 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:23.267982 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72fa67-8afd-4c8c-ae51-cfab3a5f4198 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:23.268255 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72fa67-8afd-4c8c-ae51-cfab3a5f4198 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:23.268980 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72fa67-8afd-4c8c-ae51-cfab3a5f4198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:23.269293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72fa67-8afd-4c8c-ae51-cfab3a5f4198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:23.270732 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72fa67-8afd-4c8c-ae51-cfab3a5f4198 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:23.273900 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41baea-cfb8-4cc4-ae6d-3fae344ac17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:23.274689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41baea-cfb8-4cc4-ae6d-3fae344ac17c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:23.274967 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41baea-cfb8-4cc4-ae6d-3fae344ac17c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:23.275237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41baea-cfb8-4cc4-ae6d-3fae344ac17c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:23.282415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 255/517] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:23.283248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72fa67-8afd-4c8c-ae51-cfab3a5f4198 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:23.285793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41baea-cfb8-4cc4-ae6d-3fae344ac17c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:23.287315 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41baea-cfb8-4cc4-ae6d-3fae344ac17c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:23.304868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-ce41baea-cfb8-4cc4-ae6d-3fae344ac17c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:23.306097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 263/518] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:23.306860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41baea-cfb8-4cc4-ae6d-3fae344ac17c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:23.417585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72fa67-8afd-4c8c-ae51-cfab3a5f4198 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:23.447558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41baea-cfb8-4cc4-ae6d-3fae344ac17c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:23.468415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da13d3-490c-4319-8642-e0d243e3959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:23.469675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da13d3-490c-4319-8642-e0d243e3959b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:23.470088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da13d3-490c-4319-8642-e0d243e3959b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:23.470518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da13d3-490c-4319-8642-e0d243e3959b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:23.480688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da13d3-490c-4319-8642-e0d243e3959b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:23.484140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da13d3-490c-4319-8642-e0d243e3959b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:23.498958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed610e-fa6e-4e6f-ae2b-ec3ba7f49ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:23.499979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed610e-fa6e-4e6f-ae2b-ec3ba7f49ae5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:23.500433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed610e-fa6e-4e6f-ae2b-ec3ba7f49ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:23.500880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed610e-fa6e-4e6f-ae2b-ec3ba7f49ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:23.502125 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed610e-fa6e-4e6f-ae2b-ec3ba7f49ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:23.502629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed610e-fa6e-4e6f-ae2b-ec3ba7f49ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:23.504962 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed610e-fa6e-4e6f-ae2b-ec3ba7f49ae5 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:23.506493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-54da13d3-490c-4319-8642-e0d243e3959b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:23.508452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 256/519] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:23.509886 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da13d3-490c-4319-8642-e0d243e3959b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:23.522722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 264/520] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:23.523559 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed610e-fa6e-4e6f-ae2b-ec3ba7f49ae5 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:23.640143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da13d3-490c-4319-8642-e0d243e3959b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:23.647445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed610e-fa6e-4e6f-ae2b-ec3ba7f49ae5 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:23.673360 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6f72-a332-4ba3-a6eb-0b128821942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:23.674041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6f72-a332-4ba3-a6eb-0b128821942e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:23.674322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6f72-a332-4ba3-a6eb-0b128821942e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:23.674588 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6f72-a332-4ba3-a6eb-0b128821942e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:23.675678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6f72-a332-4ba3-a6eb-0b128821942e None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=7330a81c0f3a496ea29ae911fcc69221) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:23.675984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6f72-a332-4ba3-a6eb-0b128821942e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:23.677444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6f72-a332-4ba3-a6eb-0b128821942e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:23.681801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807478f8-1be7-4f36-ae63-2eea85e9e43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:23.682598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807478f8-1be7-4f36-ae63-2eea85e9e43c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:23.682882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807478f8-1be7-4f36-ae63-2eea85e9e43c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:23.683159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807478f8-1be7-4f36-ae63-2eea85e9e43c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:23.683513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 257/521] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:23 2022] GET /identity/v3/role_assignments?user.id=7330a81c0f3a496ea29ae911fcc69221&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:23.685487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6f72-a332-4ba3-a6eb-0b128821942e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:23.698410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807478f8-1be7-4f36-ae63-2eea85e9e43c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:23.699926 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807478f8-1be7-4f36-ae63-2eea85e9e43c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:23.715179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-807478f8-1be7-4f36-ae63-2eea85e9e43c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 06 12:41:23.717236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 265/522] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:23.718150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807478f8-1be7-4f36-ae63-2eea85e9e43c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:23.817867 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6f72-a332-4ba3-a6eb-0b128821942e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:23.836937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807478f8-1be7-4f36-ae63-2eea85e9e43c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:23.864314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f4e9-812c-41cf-9481-42347405f85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:23.864636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f4e9-812c-41cf-9481-42347405f85f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:23.864772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f4e9-812c-41cf-9481-42347405f85f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:23.865098 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472f4e9-812c-41cf-9481-42347405f85f None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:23.865948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f4e9-812c-41cf-9481-42347405f85f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:23.866106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f4e9-812c-41cf-9481-42347405f85f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:23.867583 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472f4e9-812c-41cf-9481-42347405f85f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:23.888692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 258/523] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:23.888941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb197caa-c7c2-4a46-848d-64dee4b8bc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:23.889088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f4e9-812c-41cf-9481-42347405f85f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:23.889208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb197caa-c7c2-4a46-848d-64dee4b8bc52 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:23.889208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb197caa-c7c2-4a46-848d-64dee4b8bc52 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:23.889208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb197caa-c7c2-4a46-848d-64dee4b8bc52 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:23.889208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb197caa-c7c2-4a46-848d-64dee4b8bc52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:23.889208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb197caa-c7c2-4a46-848d-64dee4b8bc52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:23.890718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb197caa-c7c2-4a46-848d-64dee4b8bc52 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:23.906826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 266/524] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:23.908007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb197caa-c7c2-4a46-848d-64dee4b8bc52 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:24.001478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472f4e9-812c-41cf-9481-42347405f85f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:24.043451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12c7f1-4258-46f6-9f69-1f1313ef48a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:24.044634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12c7f1-4258-46f6-9f69-1f1313ef48a7 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:24.045144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12c7f1-4258-46f6-9f69-1f1313ef48a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:24.045665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12c7f1-4258-46f6-9f69-1f1313ef48a7 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:24.046939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12c7f1-4258-46f6-9f69-1f1313ef48a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:24.047036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb197caa-c7c2-4a46-848d-64dee4b8bc52 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:24.049710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12c7f1-4258-46f6-9f69-1f1313ef48a7 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:24.081726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 259/525] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:41:23 2022] POST /identity/v3/users => generated 247 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:41:24.083137 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12c7f1-4258-46f6-9f69-1f1313ef48a7 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:24.092661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3c93f-8363-4dd7-bc3d-f79f83f0cafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:24.094183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3c93f-8363-4dd7-bc3d-f79f83f0cafe None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:24.094668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3c93f-8363-4dd7-bc3d-f79f83f0cafe None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:24.095157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3c93f-8363-4dd7-bc3d-f79f83f0cafe None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:24.096302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3c93f-8363-4dd7-bc3d-f79f83f0cafe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:24.096835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3c93f-8363-4dd7-bc3d-f79f83f0cafe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:24.098659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3c93f-8363-4dd7-bc3d-f79f83f0cafe None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:24.139914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 267/526] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Apr 6 12:41:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:24.141229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3c93f-8363-4dd7-bc3d-f79f83f0cafe None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:24.272542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12c7f1-4258-46f6-9f69-1f1313ef48a7 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:24.306840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3c93f-8363-4dd7-bc3d-f79f83f0cafe None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:24.329964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def5960-fd7c-41d9-989a-db5bbd6281dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:24.330584 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def5960-fd7c-41d9-989a-db5bbd6281dc None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:24.331096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def5960-fd7c-41d9-989a-db5bbd6281dc None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:24.331734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def5960-fd7c-41d9-989a-db5bbd6281dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:24.349708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbafed-27d1-44fd-8ce3-c1567d90dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:24.351514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbafed-27d1-44fd-8ce3-c1567d90dd97 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:24.351646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def5960-fd7c-41d9-989a-db5bbd6281dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:24.351725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbafed-27d1-44fd-8ce3-c1567d90dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:24.351725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbafed-27d1-44fd-8ce3-c1567d90dd97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:24.353006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbafed-27d1-44fd-8ce3-c1567d90dd97 None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=65b295446c7741ea96caf60ac955d82d) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:24.353677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbafed-27d1-44fd-8ce3-c1567d90dd97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:24.354018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def5960-fd7c-41d9-989a-db5bbd6281dc None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:24.355877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbafed-27d1-44fd-8ce3-c1567d90dd97 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:24.365777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 268/527] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:24 2022] GET /identity/v3/role_assignments?user.id=65b295446c7741ea96caf60ac955d82d&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:24.367218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbafed-27d1-44fd-8ce3-c1567d90dd97 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:24.374922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-8def5960-fd7c-41d9-989a-db5bbd6281dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 12:41:24.376518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 260/528] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:24.389686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def5960-fd7c-41d9-989a-db5bbd6281dc None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:24.599238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbafed-27d1-44fd-8ce3-c1567d90dd97 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:24.620299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def5960-fd7c-41d9-989a-db5bbd6281dc None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:24.654861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d624757-42c1-41c9-bef6-1b4cffd1eadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:24.656486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d624757-42c1-41c9-bef6-1b4cffd1eadc None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:24.658026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d624757-42c1-41c9-bef6-1b4cffd1eadc None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:24.660223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d624757-42c1-41c9-bef6-1b4cffd1eadc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:24.731786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98962693-53db-447e-b275-ef3d947891d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:24.733449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98962693-53db-447e-b275-ef3d947891d5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:24.734261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98962693-53db-447e-b275-ef3d947891d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:24.735042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98962693-53db-447e-b275-ef3d947891d5 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:24.736791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98962693-53db-447e-b275-ef3d947891d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:24.737644 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98962693-53db-447e-b275-ef3d947891d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:24.749640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98962693-53db-447e-b275-ef3d947891d5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:24.766455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d624757-42c1-41c9-bef6-1b4cffd1eadc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:24.768336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d624757-42c1-41c9-bef6-1b4cffd1eadc None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:24.802215 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 261/529] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Apr 6 12:41:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:24.811906 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98962693-53db-447e-b275-ef3d947891d5 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:24.875752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 269/530] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:24.877010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d624757-42c1-41c9-bef6-1b4cffd1eadc None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:25.023529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98962693-53db-447e-b275-ef3d947891d5 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:25.030641 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d624757-42c1-41c9-bef6-1b4cffd1eadc None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:25.066199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fef3d-c787-4f5a-9743-5b875e130c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:25.067561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fef3d-c787-4f5a-9743-5b875e130c4c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:25.068547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fef3d-c787-4f5a-9743-5b875e130c4c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:25.069350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f8de-fa83-4c76-990a-2990e9f4f555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:25.070363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f8de-fa83-4c76-990a-2990e9f4f555 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:25.070989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fef3d-c787-4f5a-9743-5b875e130c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:25.072102 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f8de-fa83-4c76-990a-2990e9f4f555 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:25.072572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f8de-fa83-4c76-990a-2990e9f4f555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:25.093470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0f8de-fa83-4c76-990a-2990e9f4f555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:25.095735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0f8de-fa83-4c76-990a-2990e9f4f555 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:25.130228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-39b0f8de-fa83-4c76-990a-2990e9f4f555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:25.131701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 270/531] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:25.139266 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f8de-fa83-4c76-990a-2990e9f4f555 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:25.166427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fef3d-c787-4f5a-9743-5b875e130c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:25.168590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fef3d-c787-4f5a-9743-5b875e130c4c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:25.268242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 262/532] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:25.276127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fef3d-c787-4f5a-9743-5b875e130c4c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:25.385591 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fef3d-c787-4f5a-9743-5b875e130c4c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:25.424348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc4672-6898-4c3d-9c75-61dcc2d02cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:25.425778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4672-6898-4c3d-9c75-61dcc2d02cca None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:25.426259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4672-6898-4c3d-9c75-61dcc2d02cca None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:25.426750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc4672-6898-4c3d-9c75-61dcc2d02cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:25.438563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc4672-6898-4c3d-9c75-61dcc2d02cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:25.440368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc4672-6898-4c3d-9c75-61dcc2d02cca None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:25.459589 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-94bc4672-6898-4c3d-9c75-61dcc2d02cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:25.461899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 263/533] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:25.472939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc4672-6898-4c3d-9c75-61dcc2d02cca None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:25.481231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f8de-fa83-4c76-990a-2990e9f4f555 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:25.582258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc4672-6898-4c3d-9c75-61dcc2d02cca None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:25.619529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34388f-e9eb-4542-8774-ec798924b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:25.620991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34388f-e9eb-4542-8774-ec798924b6ac None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:25.621833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34388f-e9eb-4542-8774-ec798924b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:25.622842 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34388f-e9eb-4542-8774-ec798924b6ac None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:25.623676 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215c055-b8b4-4ad4-89a4-b8ae9ee44f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:25.624634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34388f-e9eb-4542-8774-ec798924b6ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:25.625504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c055-b8b4-4ad4-89a4-b8ae9ee44f32 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:25.626003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c055-b8b4-4ad4-89a4-b8ae9ee44f32 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:25.626474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215c055-b8b4-4ad4-89a4-b8ae9ee44f32 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:25.627395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215c055-b8b4-4ad4-89a4-b8ae9ee44f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:25.627897 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215c055-b8b4-4ad4-89a4-b8ae9ee44f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:25.629532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215c055-b8b4-4ad4-89a4-b8ae9ee44f32 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:25.630021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34388f-e9eb-4542-8774-ec798924b6ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:25.631565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34388f-e9eb-4542-8774-ec798924b6ac None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:25.642605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 264/534] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:25.646867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 271/535] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:25.652205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215c055-b8b4-4ad4-89a4-b8ae9ee44f32 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:25.654374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34388f-e9eb-4542-8774-ec798924b6ac None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:25.767655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34388f-e9eb-4542-8774-ec798924b6ac None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:25.815240 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24bad5-e7c1-4c7e-bac9-20014ea7b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:25.816408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24bad5-e7c1-4c7e-bac9-20014ea7b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:25.816930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24bad5-e7c1-4c7e-bac9-20014ea7b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:25.817400 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24bad5-e7c1-4c7e-bac9-20014ea7b4f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:25.833787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24bad5-e7c1-4c7e-bac9-20014ea7b4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:25.837291 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24bad5-e7c1-4c7e-bac9-20014ea7b4f5 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:25.868445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-ba24bad5-e7c1-4c7e-bac9-20014ea7b4f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:25.873447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 272/536] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:25.883267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24bad5-e7c1-4c7e-bac9-20014ea7b4f5 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:25.938226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215c055-b8b4-4ad4-89a4-b8ae9ee44f32 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:26.024964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24bad5-e7c1-4c7e-bac9-20014ea7b4f5 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:26.069523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b44ece-3af9-4879-ac45-089de8304eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:26.070901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b44ece-3af9-4879-ac45-089de8304eb8 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:26.071374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b44ece-3af9-4879-ac45-089de8304eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:26.071858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b44ece-3af9-4879-ac45-089de8304eb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:26.073852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425725d8-82a2-4aa9-a2b6-38c0523e4e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:26.074938 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425725d8-82a2-4aa9-a2b6-38c0523e4e84 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:26.075448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425725d8-82a2-4aa9-a2b6-38c0523e4e84 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:26.077565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425725d8-82a2-4aa9-a2b6-38c0523e4e84 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:26.079052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425725d8-82a2-4aa9-a2b6-38c0523e4e84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:26.079612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425725d8-82a2-4aa9-a2b6-38c0523e4e84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:26.082411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425725d8-82a2-4aa9-a2b6-38c0523e4e84 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:26.098969 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b44ece-3af9-4879-ac45-089de8304eb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:26.111275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b44ece-3af9-4879-ac45-089de8304eb8 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:26.135263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 273/537] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:26.136926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-06b44ece-3af9-4879-ac45-089de8304eb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:26.142120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425725d8-82a2-4aa9-a2b6-38c0523e4e84 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:26.145721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 265/538] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:26.148472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b44ece-3af9-4879-ac45-089de8304eb8 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:26.318124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b44ece-3af9-4879-ac45-089de8304eb8 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:26.372815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2469c-1e83-4918-9db9-48bc5d1335f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:26.374262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2469c-1e83-4918-9db9-48bc5d1335f3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:26.374846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2469c-1e83-4918-9db9-48bc5d1335f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:26.375506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2469c-1e83-4918-9db9-48bc5d1335f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:26.377090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2469c-1e83-4918-9db9-48bc5d1335f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:26.377794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2469c-1e83-4918-9db9-48bc5d1335f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:26.380307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2469c-1e83-4918-9db9-48bc5d1335f3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:26.417487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425725d8-82a2-4aa9-a2b6-38c0523e4e84 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:26.417811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 266/539] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:26.420529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962479d-d67c-44a7-9a64-c5202492748f None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:26.421010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962479d-d67c-44a7-9a64-c5202492748f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:26.421486 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962479d-d67c-44a7-9a64-c5202492748f None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:26.423710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 267/540] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:26.426191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962479d-d67c-44a7-9a64-c5202492748f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:26.486559 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b633f7e-f3ee-46e9-9778-9a8e76178141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:26.488012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b633f7e-f3ee-46e9-9778-9a8e76178141 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:26.488710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b633f7e-f3ee-46e9-9778-9a8e76178141 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:26.489422 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b633f7e-f3ee-46e9-9778-9a8e76178141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:26.491241 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b633f7e-f3ee-46e9-9778-9a8e76178141 None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=7bd327cdfe2c4f729252d86838aae638) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:26.492549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b633f7e-f3ee-46e9-9778-9a8e76178141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:26.495924 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b633f7e-f3ee-46e9-9778-9a8e76178141 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:26.508178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 274/541] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:26 2022] GET /identity/v3/role_assignments?user.id=7bd327cdfe2c4f729252d86838aae638&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 259 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:26.510730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511955b-ad15-48d3-8bbf-23d33295805a None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:26.511455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511955b-ad15-48d3-8bbf-23d33295805a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:26.512895 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511955b-ad15-48d3-8bbf-23d33295805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:26.547610 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d511955b-ad15-48d3-8bbf-23d33295805a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:26.550613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d511955b-ad15-48d3-8bbf-23d33295805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:26.647696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962479d-d67c-44a7-9a64-c5202492748f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:26.685647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 275/542] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:26.720918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511955b-ad15-48d3-8bbf-23d33295805a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:26.723977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f8a24-ab4b-4589-9977-b818bd15eae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:26.725380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f8a24-ab4b-4589-9977-b818bd15eae6 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:26.726137 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f8a24-ab4b-4589-9977-b818bd15eae6 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:26.726850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f8a24-ab4b-4589-9977-b818bd15eae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:26.728935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f8a24-ab4b-4589-9977-b818bd15eae6 None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=7277fd0f4cf64df4aaa65d7743b99028) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:26.729798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f8a24-ab4b-4589-9977-b818bd15eae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:26.734132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f8a24-ab4b-4589-9977-b818bd15eae6 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:26.744785 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 268/543] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:26 2022] GET /identity/v3/role_assignments?user.id=7277fd0f4cf64df4aaa65d7743b99028&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:26.968069 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511955b-ad15-48d3-8bbf-23d33295805a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:27.041901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75706da-e317-4176-8aa9-6d15daa015b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:27.043188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75706da-e317-4176-8aa9-6d15daa015b1 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:27.043672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75706da-e317-4176-8aa9-6d15daa015b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:27.044197 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75706da-e317-4176-8aa9-6d15daa015b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:27.071817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75706da-e317-4176-8aa9-6d15daa015b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:27.085382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-f75706da-e317-4176-8aa9-6d15daa015b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:27.088065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 276/544] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:27.094640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f8a24-ab4b-4589-9977-b818bd15eae6 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:27.296303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f8a24-ab4b-4589-9977-b818bd15eae6 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:27.377224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f79d3-d822-4a81-930d-21c9ddc7791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:27.379602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f79d3-d822-4a81-930d-21c9ddc7791e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:27.380397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f79d3-d822-4a81-930d-21c9ddc7791e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:27.381170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f79d3-d822-4a81-930d-21c9ddc7791e None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:27.382881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f79d3-d822-4a81-930d-21c9ddc7791e None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:27.383708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f79d3-d822-4a81-930d-21c9ddc7791e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:27.386813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f79d3-d822-4a81-930d-21c9ddc7791e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:27.402584 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 269/545] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:27.409434 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75706da-e317-4176-8aa9-6d15daa015b1 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:27.577295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75706da-e317-4176-8aa9-6d15daa015b1 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:27.644397 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72843e23-0db3-4196-8a5b-b6ce6d6789d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:27.645211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72843e23-0db3-4196-8a5b-b6ce6d6789d9 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:27.645486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72843e23-0db3-4196-8a5b-b6ce6d6789d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:27.645776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72843e23-0db3-4196-8a5b-b6ce6d6789d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:27.666233 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72843e23-0db3-4196-8a5b-b6ce6d6789d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:27.667753 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72843e23-0db3-4196-8a5b-b6ce6d6789d9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:27.694829 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-72843e23-0db3-4196-8a5b-b6ce6d6789d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:27.701991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 277/546] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:27.703791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f79d3-d822-4a81-930d-21c9ddc7791e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:27.813763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ae528-28ad-4e8f-85df-ee878d70c20e None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:27.814032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ae528-28ad-4e8f-85df-ee878d70c20e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:27.814334 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ae528-28ad-4e8f-85df-ee878d70c20e None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:27.815959 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 278/547] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:27.822484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1eaf2-d0f6-47d8-9a39-895b6b9825ef None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:27.823418 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1eaf2-d0f6-47d8-9a39-895b6b9825ef None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:27.824123 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1eaf2-d0f6-47d8-9a39-895b6b9825ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:27.852707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-dee1eaf2-d0f6-47d8-9a39-895b6b9825ef None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:27.855172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-dee1eaf2-d0f6-47d8-9a39-895b6b9825ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:27.889232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f79d3-d822-4a81-930d-21c9ddc7791e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:27.933088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61584c2-3eb6-4c5b-82ca-571a4b83ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:27.933781 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61584c2-3eb6-4c5b-82ca-571a4b83ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:27.934243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61584c2-3eb6-4c5b-82ca-571a4b83ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:27.934554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61584c2-3eb6-4c5b-82ca-571a4b83ecc1 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:27.935299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61584c2-3eb6-4c5b-82ca-571a4b83ecc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:27.935607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61584c2-3eb6-4c5b-82ca-571a4b83ecc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:27.937016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61584c2-3eb6-4c5b-82ca-571a4b83ecc1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:27.961551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 270/548] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:27.969372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61584c2-3eb6-4c5b-82ca-571a4b83ecc1 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:28.000415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 279/549] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:28.054451 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1eaf2-d0f6-47d8-9a39-895b6b9825ef None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:28.082202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61584c2-3eb6-4c5b-82ca-571a4b83ecc1 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:28.121423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857eaea-adcb-4bbf-b044-fa09e59a884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:28.122192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857eaea-adcb-4bbf-b044-fa09e59a884b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:28.122471 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857eaea-adcb-4bbf-b044-fa09e59a884b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:28.122747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857eaea-adcb-4bbf-b044-fa09e59a884b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:28.133873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857eaea-adcb-4bbf-b044-fa09e59a884b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:28.136128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857eaea-adcb-4bbf-b044-fa09e59a884b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:28.162299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-6857eaea-adcb-4bbf-b044-fa09e59a884b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 06 12:41:28.163553 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 271/550] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:28.173856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857eaea-adcb-4bbf-b044-fa09e59a884b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:28.232391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1eaf2-d0f6-47d8-9a39-895b6b9825ef None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:28.277499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f46f9-cd9d-491e-b48b-2cd4851a582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:28.279039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f46f9-cd9d-491e-b48b-2cd4851a582e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:28.279380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f46f9-cd9d-491e-b48b-2cd4851a582e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:28.279658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f46f9-cd9d-491e-b48b-2cd4851a582e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:28.307118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f46f9-cd9d-491e-b48b-2cd4851a582e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:28.321669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-593f46f9-cd9d-491e-b48b-2cd4851a582e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:28.342551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 280/551] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:28.349331 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857eaea-adcb-4bbf-b044-fa09e59a884b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:28.349536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f46f9-cd9d-491e-b48b-2cd4851a582e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:28.393191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7357b3e-9db5-466b-b2a8-8fa943d0c1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:28.394232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357b3e-9db5-466b-b2a8-8fa943d0c1d9 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:28.394718 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357b3e-9db5-466b-b2a8-8fa943d0c1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:28.395200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7357b3e-9db5-466b-b2a8-8fa943d0c1d9 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:28.396856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7357b3e-9db5-466b-b2a8-8fa943d0c1d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:28.397413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7357b3e-9db5-466b-b2a8-8fa943d0c1d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:28.400358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7357b3e-9db5-466b-b2a8-8fa943d0c1d9 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:28.427336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 272/552] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Apr 6 12:41:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:28.428680 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4cfc2-0db6-41cd-960a-d043f43422f4 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:28.428968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4cfc2-0db6-41cd-960a-d043f43422f4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:28.429245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4cfc2-0db6-41cd-960a-d043f43422f4 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:28.431344 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 273/553] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:28.437798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aac30-d247-4df6-a9bf-6cc0a7aa962c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:28.438202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aac30-d247-4df6-a9bf-6cc0a7aa962c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:28.438483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aac30-d247-4df6-a9bf-6cc0a7aa962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:28.460993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-479aac30-d247-4df6-a9bf-6cc0a7aa962c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:28.462634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-479aac30-d247-4df6-a9bf-6cc0a7aa962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:28.483375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f46f9-cd9d-491e-b48b-2cd4851a582e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:28.518851 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494b7d2-9a73-43fd-ab77-7f3cbce39261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:28.519532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b7d2-9a73-43fd-ab77-7f3cbce39261 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:28.519810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b7d2-9a73-43fd-ab77-7f3cbce39261 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:28.520134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b7d2-9a73-43fd-ab77-7f3cbce39261 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:28.520935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494b7d2-9a73-43fd-ab77-7f3cbce39261 None admin] RBAC: Adding query filter params (name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:28.521288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494b7d2-9a73-43fd-ab77-7f3cbce39261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:28.522745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494b7d2-9a73-43fd-ab77-7f3cbce39261 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:28.536667 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 281/554] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:28.537605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494b7d2-9a73-43fd-ab77-7f3cbce39261 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:28.552883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 274/555] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:28.553776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aac30-d247-4df6-a9bf-6cc0a7aa962c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:28.663100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494b7d2-9a73-43fd-ab77-7f3cbce39261 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:28.680040 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aac30-d247-4df6-a9bf-6cc0a7aa962c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:28.699545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba01af0-11a1-4ad6-860c-1a560f8d8871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:28.700744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba01af0-11a1-4ad6-860c-1a560f8d8871 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:28.701035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba01af0-11a1-4ad6-860c-1a560f8d8871 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:28.701810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba01af0-11a1-4ad6-860c-1a560f8d8871 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:28.719351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba01af0-11a1-4ad6-860c-1a560f8d8871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:28.720806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba01af0-11a1-4ad6-860c-1a560f8d8871 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:28.723810 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fe190-4243-41d3-b0cf-804e75003397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:28.724600 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fe190-4243-41d3-b0cf-804e75003397 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:28.724873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fe190-4243-41d3-b0cf-804e75003397 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:28.725140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fe190-4243-41d3-b0cf-804e75003397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:28.739734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fe190-4243-41d3-b0cf-804e75003397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:28.742117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fe190-4243-41d3-b0cf-804e75003397 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:28.742488 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-3ba01af0-11a1-4ad6-860c-1a560f8d8871 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:28.744412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 282/556] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:28.745458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba01af0-11a1-4ad6-860c-1a560f8d8871 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:28.773403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-d05fe190-4243-41d3-b0cf-804e75003397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:28.781176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 275/557] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:28.782594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fe190-4243-41d3-b0cf-804e75003397 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:28.851136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba01af0-11a1-4ad6-860c-1a560f8d8871 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:28.886136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae22888-9b50-4ca5-9139-5e32ef3b4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:28.887307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22888-9b50-4ca5-9139-5e32ef3b4360 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:28.888336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22888-9b50-4ca5-9139-5e32ef3b4360 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:28.888824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae22888-9b50-4ca5-9139-5e32ef3b4360 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:28.889015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fe190-4243-41d3-b0cf-804e75003397 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:28.899881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae22888-9b50-4ca5-9139-5e32ef3b4360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:28.907575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-eae22888-9b50-4ca5-9139-5e32ef3b4360 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:28.909389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 283/558] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:28.910439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae22888-9b50-4ca5-9139-5e32ef3b4360 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:28.928491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017464d-0d53-4b28-8e4a-44e493b5e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:28.929037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017464d-0d53-4b28-8e4a-44e493b5e31a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:28.929317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017464d-0d53-4b28-8e4a-44e493b5e31a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:28.929614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017464d-0d53-4b28-8e4a-44e493b5e31a None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:28.930384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017464d-0d53-4b28-8e4a-44e493b5e31a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:28.930632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017464d-0d53-4b28-8e4a-44e493b5e31a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:28.932028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017464d-0d53-4b28-8e4a-44e493b5e31a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:28.948836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 276/559] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:28.949765 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017464d-0d53-4b28-8e4a-44e493b5e31a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:29.016991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae22888-9b50-4ca5-9139-5e32ef3b4360 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:29.048180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017464d-0d53-4b28-8e4a-44e493b5e31a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:29.052731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a75f76-7a4c-4c24-93f9-fbacc07a90b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:29.053676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a75f76-7a4c-4c24-93f9-fbacc07a90b1 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:29.054156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a75f76-7a4c-4c24-93f9-fbacc07a90b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:29.054637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a75f76-7a4c-4c24-93f9-fbacc07a90b1 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:29.055550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a75f76-7a4c-4c24-93f9-fbacc07a90b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:29.056062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a75f76-7a4c-4c24-93f9-fbacc07a90b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:29.057767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a75f76-7a4c-4c24-93f9-fbacc07a90b1 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:29.070778 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 284/560] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:29.072614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a75f76-7a4c-4c24-93f9-fbacc07a90b1 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:29.089895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb6379-67ca-4f42-9ace-ab8612710c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:29.090983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6379-67ca-4f42-9ace-ab8612710c1a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:29.091402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6379-67ca-4f42-9ace-ab8612710c1a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:29.092022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6379-67ca-4f42-9ace-ab8612710c1a None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:29.092956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb6379-67ca-4f42-9ace-ab8612710c1a None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:29.093468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb6379-67ca-4f42-9ace-ab8612710c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:29.095646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb6379-67ca-4f42-9ace-ab8612710c1a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:29.114035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 277/561] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:29.115025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb6379-67ca-4f42-9ace-ab8612710c1a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:29.184362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a75f76-7a4c-4c24-93f9-fbacc07a90b1 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:29.222400 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1fadf-9365-43e9-a9fc-33509bd782c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:29.223545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1fadf-9365-43e9-a9fc-33509bd782c0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:29.224054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1fadf-9365-43e9-a9fc-33509bd782c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:29.224524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1fadf-9365-43e9-a9fc-33509bd782c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:29.232215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1fadf-9365-43e9-a9fc-33509bd782c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:29.233970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1fadf-9365-43e9-a9fc-33509bd782c0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:29.235993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb6379-67ca-4f42-9ace-ab8612710c1a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:29.247856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-abc1fadf-9365-43e9-a9fc-33509bd782c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:29.254183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 285/562] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:29.255257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1fadf-9365-43e9-a9fc-33509bd782c0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:29.269591 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6342be-648d-43e3-adbc-b3932b15f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:29.270394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6342be-648d-43e3-adbc-b3932b15f34a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:29.270675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6342be-648d-43e3-adbc-b3932b15f34a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:29.271036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6342be-648d-43e3-adbc-b3932b15f34a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:29.279300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6342be-648d-43e3-adbc-b3932b15f34a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:29.280971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6342be-648d-43e3-adbc-b3932b15f34a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:29.294713 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-9e6342be-648d-43e3-adbc-b3932b15f34a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 12:41:29.300386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 278/563] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:29.301227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6342be-648d-43e3-adbc-b3932b15f34a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:29.362020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1fadf-9365-43e9-a9fc-33509bd782c0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:29.396873 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67793d-e3c4-463a-ad4d-fa8cb6bef7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:29.398094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67793d-e3c4-463a-ad4d-fa8cb6bef7e5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:29.398617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67793d-e3c4-463a-ad4d-fa8cb6bef7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:29.399106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67793d-e3c4-463a-ad4d-fa8cb6bef7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:29.400570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6342be-648d-43e3-adbc-b3932b15f34a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:29.411445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67793d-e3c4-463a-ad4d-fa8cb6bef7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:29.413178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67793d-e3c4-463a-ad4d-fa8cb6bef7e5 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:29.431086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-ed67793d-e3c4-463a-ad4d-fa8cb6bef7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:29.433316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 286/564] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:29.434420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67793d-e3c4-463a-ad4d-fa8cb6bef7e5 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:29.440055 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13b48e-6950-45f3-b0be-470beb36287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:29.440716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13b48e-6950-45f3-b0be-470beb36287a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:29.440994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13b48e-6950-45f3-b0be-470beb36287a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:29.441263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13b48e-6950-45f3-b0be-470beb36287a None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:29.442101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13b48e-6950-45f3-b0be-470beb36287a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:29.442405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13b48e-6950-45f3-b0be-470beb36287a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:29.443873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13b48e-6950-45f3-b0be-470beb36287a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:29.463656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 279/565] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:29.463656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13b48e-6950-45f3-b0be-470beb36287a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:29.546973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67793d-e3c4-463a-ad4d-fa8cb6bef7e5 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:29.569116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13b48e-6950-45f3-b0be-470beb36287a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:29.582692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b60769-9cb8-4223-bc79-dcd66dc3517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:29.583725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b60769-9cb8-4223-bc79-dcd66dc3517e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:29.584214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b60769-9cb8-4223-bc79-dcd66dc3517e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:29.584683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b60769-9cb8-4223-bc79-dcd66dc3517e None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:29.585743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b60769-9cb8-4223-bc79-dcd66dc3517e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:29.586269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b60769-9cb8-4223-bc79-dcd66dc3517e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:29.587892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b60769-9cb8-4223-bc79-dcd66dc3517e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:29.603436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651386c-9560-410f-b0b1-85ef973cdb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:29.604097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651386c-9560-410f-b0b1-85ef973cdb9d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:29.604377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651386c-9560-410f-b0b1-85ef973cdb9d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:29.604645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651386c-9560-410f-b0b1-85ef973cdb9d None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:29.605366 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651386c-9560-410f-b0b1-85ef973cdb9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:29.605697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651386c-9560-410f-b0b1-85ef973cdb9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:29.607150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651386c-9560-410f-b0b1-85ef973cdb9d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:29.609823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 287/566] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Apr 6 12:41:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:29.610901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b60769-9cb8-4223-bc79-dcd66dc3517e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:29.628105 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 280/567] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:29.628864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651386c-9560-410f-b0b1-85ef973cdb9d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:29.715555 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b60769-9cb8-4223-bc79-dcd66dc3517e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:29.730539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651386c-9560-410f-b0b1-85ef973cdb9d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:29.752461 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ba306-6189-4ba6-b4e9-82eeab8a48a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:29.753781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ba306-6189-4ba6-b4e9-82eeab8a48a9 None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:29.754268 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ba306-6189-4ba6-b4e9-82eeab8a48a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:29.754745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ba306-6189-4ba6-b4e9-82eeab8a48a9 None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/7330a81c0f3a496ea29ae911fcc69221/roles/6f21bc5228c14338acc0d1711e7a1742` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:29.765315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b14306-6839-4781-ad0c-438ea573e2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:29.766004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b14306-6839-4781-ad0c-438ea573e2a6 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:29.766283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b14306-6839-4781-ad0c-438ea573e2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:29.766559 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b14306-6839-4781-ad0c-438ea573e2a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:29.773707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ba306-6189-4ba6-b4e9-82eeab8a48a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=7330a81c0f3a496ea29ae911fcc69221, role_id=6f21bc5228c14338acc0d1711e7a1742)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:29.775661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ba306-6189-4ba6-b4e9-82eeab8a48a9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:29.799587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 288/568] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:41:29 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/7330a81c0f3a496ea29ae911fcc69221/roles/6f21bc5228c14338acc0d1711e7a1742 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:29.799587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ba306-6189-4ba6-b4e9-82eeab8a48a9 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:29.900246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b14306-6839-4781-ad0c-438ea573e2a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:29.903113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b14306-6839-4781-ad0c-438ea573e2a6 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:30.023852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ba306-6189-4ba6-b4e9-82eeab8a48a9 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:30.091713 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 281/569] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:30.100427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e80140-6cd3-4981-b08b-9a83410f0bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:30.101224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80140-6cd3-4981-b08b-9a83410f0bd4 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.101496 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80140-6cd3-4981-b08b-9a83410f0bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.101815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80140-6cd3-4981-b08b-9a83410f0bd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.102877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b14306-6839-4781-ad0c-438ea573e2a6 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:30.121403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e80140-6cd3-4981-b08b-9a83410f0bd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:30.124435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e80140-6cd3-4981-b08b-9a83410f0bd4 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:30.141263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-06e80140-6cd3-4981-b08b-9a83410f0bd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 12:41:30.143238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 289/570] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Apr 6 12:41:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:30.149233 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e80140-6cd3-4981-b08b-9a83410f0bd4 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:30.220024 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b14306-6839-4781-ad0c-438ea573e2a6 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:30.252512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e80140-6cd3-4981-b08b-9a83410f0bd4 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:30.290857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fad9d4-f497-405c-8b6f-5ff3fb838b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:30.292532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad9d4-f497-405c-8b6f-5ff3fb838b5b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.293627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad9d4-f497-405c-8b6f-5ff3fb838b5b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.294359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fad9d4-f497-405c-8b6f-5ff3fb838b5b None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.296330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fad9d4-f497-405c-8b6f-5ff3fb838b5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:30.297324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fad9d4-f497-405c-8b6f-5ff3fb838b5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:30.299459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fad9d4-f497-405c-8b6f-5ff3fb838b5b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:30.303054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac926-b937-4a61-8a1f-8e739cc40d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:30.304103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac926-b937-4a61-8a1f-8e739cc40d3f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.305314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac926-b937-4a61-8a1f-8e739cc40d3f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.307482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac926-b937-4a61-8a1f-8e739cc40d3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.332573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ac926-b937-4a61-8a1f-8e739cc40d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:30.341874 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ac926-b937-4a61-8a1f-8e739cc40d3f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:30.342496 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 290/571] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Apr 6 12:41:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:30.344420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fad9d4-f497-405c-8b6f-5ff3fb838b5b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:30.374004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-162ac926-b937-4a61-8a1f-8e739cc40d3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:30.375623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 282/572] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:30.391175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ffb3-785f-4da6-bc5d-49d4ff7530b9 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.391469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ffb3-785f-4da6-bc5d-49d4ff7530b9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.391753 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69ffb3-785f-4da6-bc5d-49d4ff7530b9 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.393242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 283/573] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:30.393993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69ffb3-785f-4da6-bc5d-49d4ff7530b9 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:30.471038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fad9d4-f497-405c-8b6f-5ff3fb838b5b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:30.505729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23344b2-ceee-4076-997a-4a6a6f9b3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:30.506526 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23344b2-ceee-4076-997a-4a6a6f9b3ae8 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.506810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23344b2-ceee-4076-997a-4a6a6f9b3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.507088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23344b2-ceee-4076-997a-4a6a6f9b3ae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.513184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69ffb3-785f-4da6-bc5d-49d4ff7530b9 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:30.517133 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23344b2-ceee-4076-997a-4a6a6f9b3ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:30.518606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23344b2-ceee-4076-997a-4a6a6f9b3ae8 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:30.535270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-a23344b2-ceee-4076-997a-4a6a6f9b3ae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:30.536763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 291/574] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:30.542520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7de394-8007-4cce-beca-bd43f18672f5 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.542817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7de394-8007-4cce-beca-bd43f18672f5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.543093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7de394-8007-4cce-beca-bd43f18672f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.547110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0d2a7-049d-4fa3-a8d7-98efb312305f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:30.547776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0d2a7-049d-4fa3-a8d7-98efb312305f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.548058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0d2a7-049d-4fa3-a8d7-98efb312305f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.548330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0d2a7-049d-4fa3-a8d7-98efb312305f None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.549060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0d2a7-049d-4fa3-a8d7-98efb312305f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:30.549363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0d2a7-049d-4fa3-a8d7-98efb312305f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:30.551090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0d2a7-049d-4fa3-a8d7-98efb312305f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:30.564516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 284/575] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:30.564516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278bc3d-75eb-4c2a-bec2-30baf1fcefc1 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.564516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278bc3d-75eb-4c2a-bec2-30baf1fcefc1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.564822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278bc3d-75eb-4c2a-bec2-30baf1fcefc1 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.566617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-4a7de394-8007-4cce-beca-bd43f18672f5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:30.568416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4a7de394-8007-4cce-beca-bd43f18672f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:30.569713 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 285/576] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:30.571020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278bc3d-75eb-4c2a-bec2-30baf1fcefc1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:30.634721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 292/577] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:30.635543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7de394-8007-4cce-beca-bd43f18672f5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:30.676006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278bc3d-75eb-4c2a-bec2-30baf1fcefc1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:30.708070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613db6fa-e9f6-4a27-9e52-5ce1651bbf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:30.708727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db6fa-e9f6-4a27-9e52-5ce1651bbf43 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.709005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db6fa-e9f6-4a27-9e52-5ce1651bbf43 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.709270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db6fa-e9f6-4a27-9e52-5ce1651bbf43 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.710010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613db6fa-e9f6-4a27-9e52-5ce1651bbf43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:30.710315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613db6fa-e9f6-4a27-9e52-5ce1651bbf43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:30.711706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613db6fa-e9f6-4a27-9e52-5ce1651bbf43 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:30.723752 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 286/578] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:30.724996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1f904-c268-4178-aef4-ca621d49df55 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.725284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1f904-c268-4178-aef4-ca621d49df55 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.725594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1f904-c268-4178-aef4-ca621d49df55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.738364 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7de394-8007-4cce-beca-bd43f18672f5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:30.742863 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-61b1f904-c268-4178-aef4-ca621d49df55 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:30.744057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-61b1f904-c268-4178-aef4-ca621d49df55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:30.774871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c330fe-5426-4af0-a80d-455e66af1a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:30.775695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c330fe-5426-4af0-a80d-455e66af1a25 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.775972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c330fe-5426-4af0-a80d-455e66af1a25 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.776240 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c330fe-5426-4af0-a80d-455e66af1a25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.783706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c330fe-5426-4af0-a80d-455e66af1a25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:30.785370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c330fe-5426-4af0-a80d-455e66af1a25 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:30.805454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-05c330fe-5426-4af0-a80d-455e66af1a25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:30.806983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 293/579] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:30.807879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c330fe-5426-4af0-a80d-455e66af1a25 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:30.829596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 287/580] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:30.829596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1f904-c268-4178-aef4-ca621d49df55 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:30.928528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1f904-c268-4178-aef4-ca621d49df55 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:30.929710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c330fe-5426-4af0-a80d-455e66af1a25 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:30.963424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe4463-18ce-4347-8c02-92d929fa3272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:30.964222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe4463-18ce-4347-8c02-92d929fa3272 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.964607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe4463-18ce-4347-8c02-92d929fa3272 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.964839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe4463-18ce-4347-8c02-92d929fa3272 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.965260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ff8bb-04e2-447c-8bb1-e9f1eb28101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:30.966268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ff8bb-04e2-447c-8bb1-e9f1eb28101d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:30.966550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ff8bb-04e2-447c-8bb1-e9f1eb28101d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:30.966820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ff8bb-04e2-447c-8bb1-e9f1eb28101d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:30.973709 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ff8bb-04e2-447c-8bb1-e9f1eb28101d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:30.975170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ff8bb-04e2-447c-8bb1-e9f1eb28101d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:30.975280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe4463-18ce-4347-8c02-92d929fa3272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:30.982299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-c9fe4463-18ce-4347-8c02-92d929fa3272 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:30.983645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 294/581] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:30.984245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe4463-18ce-4347-8c02-92d929fa3272 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:30.990161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-311ff8bb-04e2-447c-8bb1-e9f1eb28101d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:30.991474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 288/582] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:30.996063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ff8bb-04e2-447c-8bb1-e9f1eb28101d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.085049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe4463-18ce-4347-8c02-92d929fa3272 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.098989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ff8bb-04e2-447c-8bb1-e9f1eb28101d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.120907 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e954a8e-10a0-433d-a503-3c0711f036ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:31.121810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e954a8e-10a0-433d-a503-3c0711f036ca None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:31.122318 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e954a8e-10a0-433d-a503-3c0711f036ca None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:31.122736 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e954a8e-10a0-433d-a503-3c0711f036ca None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:31.123664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e954a8e-10a0-433d-a503-3c0711f036ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:31.124116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e954a8e-10a0-433d-a503-3c0711f036ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:31.125735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e954a8e-10a0-433d-a503-3c0711f036ca None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:31.131346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3568738-8d7c-4c60-a4c0-806ab9d4e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:31.132137 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568738-8d7c-4c60-a4c0-806ab9d4e730 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:31.132415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568738-8d7c-4c60-a4c0-806ab9d4e730 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:31.132685 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568738-8d7c-4c60-a4c0-806ab9d4e730 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:31.138730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 295/583] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:31.139546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e954a8e-10a0-433d-a503-3c0711f036ca None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.148508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3568738-8d7c-4c60-a4c0-806ab9d4e730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:31.156382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-f3568738-8d7c-4c60-a4c0-806ab9d4e730 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:31.162287 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 289/584] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:31.162287 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3568738-8d7c-4c60-a4c0-806ab9d4e730 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.246047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e954a8e-10a0-433d-a503-3c0711f036ca None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.258705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3568738-8d7c-4c60-a4c0-806ab9d4e730 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.281871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c469e9-8848-41e2-b56d-fd701d537780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:31.282539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c469e9-8848-41e2-b56d-fd701d537780 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:31.282908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c469e9-8848-41e2-b56d-fd701d537780 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:31.283191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c469e9-8848-41e2-b56d-fd701d537780 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:31.283940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c469e9-8848-41e2-b56d-fd701d537780 None admin] RBAC: Adding query filter params (name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:31.284248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c469e9-8848-41e2-b56d-fd701d537780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:31.285637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c469e9-8848-41e2-b56d-fd701d537780 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:31.291436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301ec6-52a7-4e22-99f9-98e75b7dbcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:31.292086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301ec6-52a7-4e22-99f9-98e75b7dbcab None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:31.292367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301ec6-52a7-4e22-99f9-98e75b7dbcab None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:31.292640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301ec6-52a7-4e22-99f9-98e75b7dbcab None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:31.300208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af301ec6-52a7-4e22-99f9-98e75b7dbcab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:31.300355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 296/585] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:31.300454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af301ec6-52a7-4e22-99f9-98e75b7dbcab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:31.300529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c469e9-8848-41e2-b56d-fd701d537780 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.300597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af301ec6-52a7-4e22-99f9-98e75b7dbcab None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:31.307743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 290/586] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:31.308878 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301ec6-52a7-4e22-99f9-98e75b7dbcab None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.408993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c469e9-8848-41e2-b56d-fd701d537780 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.413172 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301ec6-52a7-4e22-99f9-98e75b7dbcab None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.441861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaca0bd-a961-4341-adcb-8af8634defd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:31.442513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaca0bd-a961-4341-adcb-8af8634defd1 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:31.442791 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaca0bd-a961-4341-adcb-8af8634defd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:31.443061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaca0bd-a961-4341-adcb-8af8634defd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:31.443874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaca0bd-a961-4341-adcb-8af8634defd1 None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=0118661184dc4cb198f65e831fb1fe8f) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:31.444180 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaca0bd-a961-4341-adcb-8af8634defd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:31.445679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaca0bd-a961-4341-adcb-8af8634defd1 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:31.446749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9d39f-4e66-4f31-bc53-db28e78ece15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:31.447417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d39f-4e66-4f31-bc53-db28e78ece15 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:31.447702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d39f-4e66-4f31-bc53-db28e78ece15 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:31.447976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9d39f-4e66-4f31-bc53-db28e78ece15 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:31.448716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9d39f-4e66-4f31-bc53-db28e78ece15 None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:31.449023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9d39f-4e66-4f31-bc53-db28e78ece15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:31.451497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9d39f-4e66-4f31-bc53-db28e78ece15 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:31.461627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 297/587] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:31 2022] GET /identity/v3/role_assignments?user.id=0118661184dc4cb198f65e831fb1fe8f&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:31.461627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaca0bd-a961-4341-adcb-8af8634defd1 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.461901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 291/588] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:31.461901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9d39f-4e66-4f31-bc53-db28e78ece15 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.578627 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9d39f-4e66-4f31-bc53-db28e78ece15 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.588871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaca0bd-a961-4341-adcb-8af8634defd1 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.613356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1647c0a-dc12-4051-bbe4-40fc47de9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:31.614292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647c0a-dc12-4051-bbe4-40fc47de9588 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:31.614573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647c0a-dc12-4051-bbe4-40fc47de9588 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:31.614848 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1647c0a-dc12-4051-bbe4-40fc47de9588 None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/65b295446c7741ea96caf60ac955d82d/roles/6f21bc5228c14338acc0d1711e7a1742` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:31.627086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b85e6-595c-4033-8ba7-21eb9aab0b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:31.628354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b85e6-595c-4033-8ba7-21eb9aab0b01 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:31.628862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b85e6-595c-4033-8ba7-21eb9aab0b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:31.629327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b85e6-595c-4033-8ba7-21eb9aab0b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:31.631303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1647c0a-dc12-4051-bbe4-40fc47de9588 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=65b295446c7741ea96caf60ac955d82d, role_id=6f21bc5228c14338acc0d1711e7a1742)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:31.632946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1647c0a-dc12-4051-bbe4-40fc47de9588 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:31.643702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b85e6-595c-4033-8ba7-21eb9aab0b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:31.645812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b85e6-595c-4033-8ba7-21eb9aab0b01 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:31.657604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 292/589] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:41:31 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/65b295446c7741ea96caf60ac955d82d/roles/6f21bc5228c14338acc0d1711e7a1742 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:31.657604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1647c0a-dc12-4051-bbe4-40fc47de9588 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.683460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-263b85e6-595c-4033-8ba7-21eb9aab0b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:31.685500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 298/590] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:31.691406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b85e6-595c-4033-8ba7-21eb9aab0b01 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.785444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1647c0a-dc12-4051-bbe4-40fc47de9588 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.800896 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b85e6-595c-4033-8ba7-21eb9aab0b01 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.824615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898b414-2bc8-4f9d-8d8d-ba30be834f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:31.826877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898b414-2bc8-4f9d-8d8d-ba30be834f5b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:31.827221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898b414-2bc8-4f9d-8d8d-ba30be834f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:31.827562 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898b414-2bc8-4f9d-8d8d-ba30be834f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:31.840898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898b414-2bc8-4f9d-8d8d-ba30be834f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:31.843386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1c0db-1889-4c47-a228-9b6ce26386bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:31.843521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898b414-2bc8-4f9d-8d8d-ba30be834f5b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:31.844062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1c0db-1889-4c47-a228-9b6ce26386bc None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:31.844342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1c0db-1889-4c47-a228-9b6ce26386bc None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:31.844614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1c0db-1889-4c47-a228-9b6ce26386bc None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:31.845340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1c0db-1889-4c47-a228-9b6ce26386bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:31.845681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1c0db-1889-4c47-a228-9b6ce26386bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:31.847081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1c0db-1889-4c47-a228-9b6ce26386bc None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:31.860463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 299/591] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:31.862631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-3898b414-2bc8-4f9d-8d8d-ba30be834f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:31.864159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 293/592] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:31.865965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1c0db-1889-4c47-a228-9b6ce26386bc None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.869443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898b414-2bc8-4f9d-8d8d-ba30be834f5b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:31.973526 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1c0db-1889-4c47-a228-9b6ce26386bc None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:31.976353 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898b414-2bc8-4f9d-8d8d-ba30be834f5b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:32.016440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd48d1d-c50c-4cb5-8644-29b359e2120d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:32.017134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd48d1d-c50c-4cb5-8644-29b359e2120d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.017420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd48d1d-c50c-4cb5-8644-29b359e2120d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.017739 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd48d1d-c50c-4cb5-8644-29b359e2120d None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.018620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd48d1d-c50c-4cb5-8644-29b359e2120d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:32.019047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd48d1d-c50c-4cb5-8644-29b359e2120d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:32.021023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd48d1d-c50c-4cb5-8644-29b359e2120d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:32.022292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11812-86bb-40d5-8b60-e0cfdb27ce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:32.023561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11812-86bb-40d5-8b60-e0cfdb27ce94 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.023844 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11812-86bb-40d5-8b60-e0cfdb27ce94 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.024701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c11812-86bb-40d5-8b60-e0cfdb27ce94 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.035232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 294/593] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:32.035565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11812-86bb-40d5-8b60-e0cfdb27ce94 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:32.036960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c11812-86bb-40d5-8b60-e0cfdb27ce94 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:32.040824 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd48d1d-c50c-4cb5-8644-29b359e2120d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:32.056746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-32c11812-86bb-40d5-8b60-e0cfdb27ce94 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 12:41:32.058328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 300/594] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:32.064985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11812-86bb-40d5-8b60-e0cfdb27ce94 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:32.183861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c11812-86bb-40d5-8b60-e0cfdb27ce94 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:32.221038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd48d1d-c50c-4cb5-8644-29b359e2120d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:32.255010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849965da-7ba8-4d89-baf0-1737d5b029b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:32.255604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849965da-7ba8-4d89-baf0-1737d5b029b3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.255890 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849965da-7ba8-4d89-baf0-1737d5b029b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.256171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849965da-7ba8-4d89-baf0-1737d5b029b3 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.257017 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849965da-7ba8-4d89-baf0-1737d5b029b3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:32.257327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849965da-7ba8-4d89-baf0-1737d5b029b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:32.258814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849965da-7ba8-4d89-baf0-1737d5b029b3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:32.281348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dc805-ee04-426b-85bf-50baba3b6934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:32.282200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc805-ee04-426b-85bf-50baba3b6934 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.282479 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc805-ee04-426b-85bf-50baba3b6934 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.282748 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915dc805-ee04-426b-85bf-50baba3b6934 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.290730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dc805-ee04-426b-85bf-50baba3b6934 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:32.292217 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915dc805-ee04-426b-85bf-50baba3b6934 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:32.292925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 301/595] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Apr 6 12:41:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:32.299204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849965da-7ba8-4d89-baf0-1737d5b029b3 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:32.307999 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-915dc805-ee04-426b-85bf-50baba3b6934 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 06 12:41:32.313817 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 295/596] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:32.315244 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dc805-ee04-426b-85bf-50baba3b6934 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:32.423936 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915dc805-ee04-426b-85bf-50baba3b6934 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:32.456211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849965da-7ba8-4d89-baf0-1737d5b029b3 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:32.458573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460b54a-cf07-4fa8-9952-db4147bb2795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:32.459256 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460b54a-cf07-4fa8-9952-db4147bb2795 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.459541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460b54a-cf07-4fa8-9952-db4147bb2795 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.459819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460b54a-cf07-4fa8-9952-db4147bb2795 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.460674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460b54a-cf07-4fa8-9952-db4147bb2795 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:32.460985 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460b54a-cf07-4fa8-9952-db4147bb2795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:32.462476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460b54a-cf07-4fa8-9952-db4147bb2795 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:32.481123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 296/597] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Apr 6 12:41:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:32.487200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460b54a-cf07-4fa8-9952-db4147bb2795 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:32.490482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04724a2d-26c9-4cec-97b3-2a4196dfa9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:32.491280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04724a2d-26c9-4cec-97b3-2a4196dfa9bf None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.491567 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04724a2d-26c9-4cec-97b3-2a4196dfa9bf None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.491842 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04724a2d-26c9-4cec-97b3-2a4196dfa9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.502697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04724a2d-26c9-4cec-97b3-2a4196dfa9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:32.504145 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04724a2d-26c9-4cec-97b3-2a4196dfa9bf None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:32.521922 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-04724a2d-26c9-4cec-97b3-2a4196dfa9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:32.523453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 302/598] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:32.524781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6571c2-dbbd-4cf3-82f2-94f69c65d679 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.525068 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6571c2-dbbd-4cf3-82f2-94f69c65d679 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.525343 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6571c2-dbbd-4cf3-82f2-94f69c65d679 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.526877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 303/599] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:32.530412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6571c2-dbbd-4cf3-82f2-94f69c65d679 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:32.594180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460b54a-cf07-4fa8-9952-db4147bb2795 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:32.628970 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed98951-71ac-40f5-a92f-19ef6772b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:32.629802 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98951-71ac-40f5-a92f-19ef6772b6de None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.630089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98951-71ac-40f5-a92f-19ef6772b6de None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.630369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98951-71ac-40f5-a92f-19ef6772b6de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.632897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6571c2-dbbd-4cf3-82f2-94f69c65d679 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:32.642304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed98951-71ac-40f5-a92f-19ef6772b6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:32.643796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed98951-71ac-40f5-a92f-19ef6772b6de None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:32.662278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-2ed98951-71ac-40f5-a92f-19ef6772b6de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:32.668120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 297/600] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:32.669200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811d73c-5111-45fe-a33b-f858e4fece9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:32.669914 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f4d90-894c-4ece-8632-977ec035e649 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.670236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811d73c-5111-45fe-a33b-f858e4fece9c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.670415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f4d90-894c-4ece-8632-977ec035e649 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.670577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811d73c-5111-45fe-a33b-f858e4fece9c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.670723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f4d90-894c-4ece-8632-977ec035e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.670885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811d73c-5111-45fe-a33b-f858e4fece9c None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.671501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811d73c-5111-45fe-a33b-f858e4fece9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:32.671807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811d73c-5111-45fe-a33b-f858e4fece9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:32.673187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811d73c-5111-45fe-a33b-f858e4fece9c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:32.685801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 304/601] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:32.686726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811d73c-5111-45fe-a33b-f858e4fece9c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:32.691422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-351f4d90-894c-4ece-8632-977ec035e649 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:32.692627 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-351f4d90-894c-4ece-8632-977ec035e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:32.762207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 298/602] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:32.763647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f4d90-894c-4ece-8632-977ec035e649 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:32.785983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811d73c-5111-45fe-a33b-f858e4fece9c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:32.820971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4280e-cf46-4b25-b6fe-a047d569ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:32.821959 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4280e-cf46-4b25-b6fe-a047d569ca06 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.822241 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4280e-cf46-4b25-b6fe-a047d569ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.822513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4280e-cf46-4b25-b6fe-a047d569ca06 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.823722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4280e-cf46-4b25-b6fe-a047d569ca06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:32.824037 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4280e-cf46-4b25-b6fe-a047d569ca06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:32.826744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4280e-cf46-4b25-b6fe-a047d569ca06 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:32.843104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 305/603] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:32.844412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4280e-cf46-4b25-b6fe-a047d569ca06 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:32.877015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f4d90-894c-4ece-8632-977ec035e649 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:32.913731 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ec76d-8dd2-46d7-8d7c-764d5a12c42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:32.914587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ec76d-8dd2-46d7-8d7c-764d5a12c42f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:32.914871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ec76d-8dd2-46d7-8d7c-764d5a12c42f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:32.915149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ec76d-8dd2-46d7-8d7c-764d5a12c42f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:32.922696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ec76d-8dd2-46d7-8d7c-764d5a12c42f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:32.924187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ec76d-8dd2-46d7-8d7c-764d5a12c42f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:32.938497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-ad4ec76d-8dd2-46d7-8d7c-764d5a12c42f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:32.940030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 299/604] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:32.940864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ec76d-8dd2-46d7-8d7c-764d5a12c42f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:32.966186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4280e-cf46-4b25-b6fe-a047d569ca06 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:33.011583 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b5063-8e57-42e5-bd63-c0293563ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:33.013223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b5063-8e57-42e5-bd63-c0293563ec53 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:33.013506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b5063-8e57-42e5-bd63-c0293563ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:33.013964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b5063-8e57-42e5-bd63-c0293563ec53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:33.027603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b5063-8e57-42e5-bd63-c0293563ec53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:33.036164 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-f89b5063-8e57-42e5-bd63-c0293563ec53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:33.037701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 306/605] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:33.038684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b5063-8e57-42e5-bd63-c0293563ec53 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:33.052480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ec76d-8dd2-46d7-8d7c-764d5a12c42f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:33.088127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310ab5-48cf-438e-b235-1f48a089043c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:33.088933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310ab5-48cf-438e-b235-1f48a089043c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:33.089219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310ab5-48cf-438e-b235-1f48a089043c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:33.089497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310ab5-48cf-438e-b235-1f48a089043c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:33.097290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd310ab5-48cf-438e-b235-1f48a089043c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:33.098870 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd310ab5-48cf-438e-b235-1f48a089043c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:33.113580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-dd310ab5-48cf-438e-b235-1f48a089043c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:33.119535 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 300/606] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:33.120411 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310ab5-48cf-438e-b235-1f48a089043c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:33.157049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b5063-8e57-42e5-bd63-c0293563ec53 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:33.201752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de00321-0615-4611-be4e-d3c3b1500cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:33.202419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00321-0615-4611-be4e-d3c3b1500cac None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:33.202702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00321-0615-4611-be4e-d3c3b1500cac None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:33.202973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de00321-0615-4611-be4e-d3c3b1500cac None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:33.204200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de00321-0615-4611-be4e-d3c3b1500cac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:33.204512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de00321-0615-4611-be4e-d3c3b1500cac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:33.206356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de00321-0615-4611-be4e-d3c3b1500cac None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:33.221699 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 307/607] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:33.222545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de00321-0615-4611-be4e-d3c3b1500cac None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:33.234090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310ab5-48cf-438e-b235-1f48a089043c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:33.269672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994ffaf-4bbc-4843-b6c9-5ee410ad71ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:33.270344 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994ffaf-4bbc-4843-b6c9-5ee410ad71ba None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:33.270628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994ffaf-4bbc-4843-b6c9-5ee410ad71ba None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:33.270950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994ffaf-4bbc-4843-b6c9-5ee410ad71ba None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:33.271786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994ffaf-4bbc-4843-b6c9-5ee410ad71ba None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:33.272148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994ffaf-4bbc-4843-b6c9-5ee410ad71ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:33.273626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994ffaf-4bbc-4843-b6c9-5ee410ad71ba None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:33.283103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 301/608] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:33.283954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994ffaf-4bbc-4843-b6c9-5ee410ad71ba None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:33.344501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de00321-0615-4611-be4e-d3c3b1500cac None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:33.386921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bff533-0667-45b9-ab32-4d2d3552ba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:33.388234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff533-0667-45b9-ab32-4d2d3552ba85 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:33.388609 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff533-0667-45b9-ab32-4d2d3552ba85 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:33.388967 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff533-0667-45b9-ab32-4d2d3552ba85 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:33.389798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bff533-0667-45b9-ab32-4d2d3552ba85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:33.390109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bff533-0667-45b9-ab32-4d2d3552ba85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:33.391285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994ffaf-4bbc-4843-b6c9-5ee410ad71ba None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:33.391676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bff533-0667-45b9-ab32-4d2d3552ba85 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:33.409248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 308/609] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:33.410184 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bff533-0667-45b9-ab32-4d2d3552ba85 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:33.431015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85818c1f-cbb3-414c-93f8-2fdb905317d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:33.432390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85818c1f-cbb3-414c-93f8-2fdb905317d0 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:33.432673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85818c1f-cbb3-414c-93f8-2fdb905317d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:33.433223 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85818c1f-cbb3-414c-93f8-2fdb905317d0 None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/7277fd0f4cf64df4aaa65d7743b99028/roles/6f21bc5228c14338acc0d1711e7a1742` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:33.452176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85818c1f-cbb3-414c-93f8-2fdb905317d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=7277fd0f4cf64df4aaa65d7743b99028, role_id=6f21bc5228c14338acc0d1711e7a1742)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:33.454402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85818c1f-cbb3-414c-93f8-2fdb905317d0 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:33.474003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 302/610] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:41:33 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/7277fd0f4cf64df4aaa65d7743b99028/roles/6f21bc5228c14338acc0d1711e7a1742 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:33.474887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85818c1f-cbb3-414c-93f8-2fdb905317d0 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:33.530098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bff533-0667-45b9-ab32-4d2d3552ba85 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:33.598211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85818c1f-cbb3-414c-93f8-2fdb905317d0 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:33.635046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4196-cfcb-4df0-9d99-ed3493a4ded5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:33.635843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4196-cfcb-4df0-9d99-ed3493a4ded5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:33.636131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4196-cfcb-4df0-9d99-ed3493a4ded5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:33.636438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb4196-cfcb-4df0-9d99-ed3493a4ded5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:33.637176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f291698-fa44-423c-866f-3bf8407ae8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:33.638254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f291698-fa44-423c-866f-3bf8407ae8b9 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:33.638669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f291698-fa44-423c-866f-3bf8407ae8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:33.638946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f291698-fa44-423c-866f-3bf8407ae8b9 None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/7bd327cdfe2c4f729252d86838aae638/roles/6f21bc5228c14338acc0d1711e7a1742` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:33.656730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f291698-fa44-423c-866f-3bf8407ae8b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=7bd327cdfe2c4f729252d86838aae638, role_id=6f21bc5228c14338acc0d1711e7a1742)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:33.658271 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f291698-fa44-423c-866f-3bf8407ae8b9 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:33.664492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb4196-cfcb-4df0-9d99-ed3493a4ded5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:33.666143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb4196-cfcb-4df0-9d99-ed3493a4ded5 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:33.690944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-6ebb4196-cfcb-4df0-9d99-ed3493a4ded5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:33.693023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 309/611] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:33.694059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 303/612] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:41:33 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/7bd327cdfe2c4f729252d86838aae638/roles/6f21bc5228c14338acc0d1711e7a1742 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:33.697669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4196-cfcb-4df0-9d99-ed3493a4ded5 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:33.821627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb4196-cfcb-4df0-9d99-ed3493a4ded5 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:33.868990 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2af7-5eae-4c64-a402-62a6be8f0ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:33.870332 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2af7-5eae-4c64-a402-62a6be8f0ac3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:33.870821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2af7-5eae-4c64-a402-62a6be8f0ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:33.871373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e2af7-5eae-4c64-a402-62a6be8f0ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:33.872931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e2af7-5eae-4c64-a402-62a6be8f0ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:33.873441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e2af7-5eae-4c64-a402-62a6be8f0ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:33.875051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e2af7-5eae-4c64-a402-62a6be8f0ac3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:33.892044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 310/613] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:33.897623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f291698-fa44-423c-866f-3bf8407ae8b9 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:34.008206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f291698-fa44-423c-866f-3bf8407ae8b9 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:34.047224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00201b-5ff8-42bd-92fc-9d062a3348da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:34.048401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00201b-5ff8-42bd-92fc-9d062a3348da None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:34.048888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00201b-5ff8-42bd-92fc-9d062a3348da None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:34.049362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00201b-5ff8-42bd-92fc-9d062a3348da None admin] PATH_INFO: `/v3/users/glance` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:34.057631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00201b-5ff8-42bd-92fc-9d062a3348da None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:34.059919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00201b-5ff8-42bd-92fc-9d062a3348da None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:34.074501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-3e00201b-5ff8-42bd-92fc-9d062a3348da None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 06 12:41:34.077094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 304/614] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:34.082371 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2af7-5eae-4c64-a402-62a6be8f0ac3 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:34.199374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e2af7-5eae-4c64-a402-62a6be8f0ac3 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:34.235081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0eca-d988-467e-b469-cde49b7a8314 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:34.235400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0eca-d988-467e-b469-cde49b7a8314 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:34.235626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c0eca-d988-467e-b469-cde49b7a8314 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:34.237227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 305/615] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:34.242746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7876b-961a-4f0d-b403-ce4fb5ad3dd6 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:34.243130 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7876b-961a-4f0d-b403-ce4fb5ad3dd6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:34.243406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7876b-961a-4f0d-b403-ce4fb5ad3dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:34.245108 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b759dd-b000-4435-a167-64bd571b979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:34.245802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b759dd-b000-4435-a167-64bd571b979b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:34.246085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b759dd-b000-4435-a167-64bd571b979b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:34.246362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b759dd-b000-4435-a167-64bd571b979b None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:34.247764 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b759dd-b000-4435-a167-64bd571b979b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:34.248074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b759dd-b000-4435-a167-64bd571b979b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:34.249495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b759dd-b000-4435-a167-64bd571b979b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:34.267278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 311/616] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Apr 6 12:41:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:34.273175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b759dd-b000-4435-a167-64bd571b979b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:34.287769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-a0d7876b-961a-4f0d-b403-ce4fb5ad3dd6 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:34.289160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a0d7876b-961a-4f0d-b403-ce4fb5ad3dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:34.405129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 306/617] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:34.445149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7876b-961a-4f0d-b403-ce4fb5ad3dd6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:34.458053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b759dd-b000-4435-a167-64bd571b979b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:34.532028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eeb1f-6281-4702-b074-7fe3e0528de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:34.533047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eeb1f-6281-4702-b074-7fe3e0528de5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:34.533561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eeb1f-6281-4702-b074-7fe3e0528de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:34.534055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eeb1f-6281-4702-b074-7fe3e0528de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:34.585984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7876b-961a-4f0d-b403-ce4fb5ad3dd6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:34.634367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc74432-158a-449b-ae1a-079c78193b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:34.635170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74432-158a-449b-ae1a-079c78193b23 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:34.635437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74432-158a-449b-ae1a-079c78193b23 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:34.635707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc74432-158a-449b-ae1a-079c78193b23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:34.648384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc74432-158a-449b-ae1a-079c78193b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:34.651350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eeb1f-6281-4702-b074-7fe3e0528de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:34.653464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eeb1f-6281-4702-b074-7fe3e0528de5 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:34.655748 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-cfc74432-158a-449b-ae1a-079c78193b23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:34.657401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 307/618] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:34.658647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af4c4-5c1a-41c4-94e3-2807eda5e8a3 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:34.658934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af4c4-5c1a-41c4-94e3-2807eda5e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:34.659207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af4c4-5c1a-41c4-94e3-2807eda5e8a3 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:34.664531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 308/619] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:34.664531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9af4c4-5c1a-41c4-94e3-2807eda5e8a3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:34.784745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9af4c4-5c1a-41c4-94e3-2807eda5e8a3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:34.788427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 312/620] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:34.789987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb320d-e062-46a1-93e5-6e0d33aad067 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:34.790484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb320d-e062-46a1-93e5-6e0d33aad067 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:34.791008 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb320d-e062-46a1-93e5-6e0d33aad067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:34.811770 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5cbb320d-e062-46a1-93e5-6e0d33aad067 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:34.813836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5cbb320d-e062-46a1-93e5-6e0d33aad067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:34.828518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428c878-dd3e-49b6-a2be-e0cf6ae8b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:34.829196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428c878-dd3e-49b6-a2be-e0cf6ae8b69f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:34.829478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428c878-dd3e-49b6-a2be-e0cf6ae8b69f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:34.829800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428c878-dd3e-49b6-a2be-e0cf6ae8b69f None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:34.831150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428c878-dd3e-49b6-a2be-e0cf6ae8b69f None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:34.831463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428c878-dd3e-49b6-a2be-e0cf6ae8b69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:34.833042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428c878-dd3e-49b6-a2be-e0cf6ae8b69f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:34.844674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 309/621] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:34.845892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428c878-dd3e-49b6-a2be-e0cf6ae8b69f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:34.909595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 313/622] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:34.909595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb320d-e062-46a1-93e5-6e0d33aad067 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.004502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428c878-dd3e-49b6-a2be-e0cf6ae8b69f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.020348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb320d-e062-46a1-93e5-6e0d33aad067 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.040071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ec3dc-3123-42b0-ad79-735c2b9b93a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.040779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ec3dc-3123-42b0-ad79-735c2b9b93a1 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.041059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ec3dc-3123-42b0-ad79-735c2b9b93a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.041333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ec3dc-3123-42b0-ad79-735c2b9b93a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.052914 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ec3dc-3123-42b0-ad79-735c2b9b93a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.054732 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ec3dc-3123-42b0-ad79-735c2b9b93a1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.068422 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec60ab3-3456-490a-828b-a188727d47fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.069498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec60ab3-3456-490a-828b-a188727d47fc None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.069975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec60ab3-3456-490a-828b-a188727d47fc None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.070405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec60ab3-3456-490a-828b-a188727d47fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.071530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-dd8ec3dc-3123-42b0-ad79-735c2b9b93a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:35.077770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 310/623] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:35.077770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ec3dc-3123-42b0-ad79-735c2b9b93a1 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.086847 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec60ab3-3456-490a-828b-a188727d47fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.088394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec60ab3-3456-490a-828b-a188727d47fc None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.105695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-7ec60ab3-3456-490a-828b-a188727d47fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:35.107365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 314/624] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:35.108211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec60ab3-3456-490a-828b-a188727d47fc None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.195529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ec3dc-3123-42b0-ad79-735c2b9b93a1 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.229063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990c786-11ff-4bae-b817-fa5a7f6c16e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.230024 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990c786-11ff-4bae-b817-fa5a7f6c16e1 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.230379 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990c786-11ff-4bae-b817-fa5a7f6c16e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.230721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990c786-11ff-4bae-b817-fa5a7f6c16e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.231165 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec60ab3-3456-490a-828b-a188727d47fc None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.241371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990c786-11ff-4bae-b817-fa5a7f6c16e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:35.249092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-d990c786-11ff-4bae-b817-fa5a7f6c16e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:35.255445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 311/625] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:35.256173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990c786-11ff-4bae-b817-fa5a7f6c16e1 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.279417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ab32-5757-45ac-90a4-98cb38a30ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.280080 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ab32-5757-45ac-90a4-98cb38a30ed0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.280349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ab32-5757-45ac-90a4-98cb38a30ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.280618 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ab32-5757-45ac-90a4-98cb38a30ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.281332 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0ab32-5757-45ac-90a4-98cb38a30ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:35.281671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0ab32-5757-45ac-90a4-98cb38a30ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.283031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0ab32-5757-45ac-90a4-98cb38a30ed0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.299413 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 315/626] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:35.299413 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ab32-5757-45ac-90a4-98cb38a30ed0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.378213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990c786-11ff-4bae-b817-fa5a7f6c16e1 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.409797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ab32-5757-45ac-90a4-98cb38a30ed0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.417545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60089c79-cd39-4eb2-b4d3-62719fe760bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.418498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60089c79-cd39-4eb2-b4d3-62719fe760bc None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.419565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60089c79-cd39-4eb2-b4d3-62719fe760bc None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.420068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60089c79-cd39-4eb2-b4d3-62719fe760bc None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.421003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60089c79-cd39-4eb2-b4d3-62719fe760bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:35.421509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60089c79-cd39-4eb2-b4d3-62719fe760bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.423156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60089c79-cd39-4eb2-b4d3-62719fe760bc None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.436930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 312/627] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:35.438184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60089c79-cd39-4eb2-b4d3-62719fe760bc None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.444948 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e113ff-113d-42d1-9543-b348a0bb80e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.445675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e113ff-113d-42d1-9543-b348a0bb80e3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.445958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e113ff-113d-42d1-9543-b348a0bb80e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.446227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e113ff-113d-42d1-9543-b348a0bb80e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.447027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e113ff-113d-42d1-9543-b348a0bb80e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:35.447328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e113ff-113d-42d1-9543-b348a0bb80e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.448732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e113ff-113d-42d1-9543-b348a0bb80e3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.462456 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 316/628] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:35.463418 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e113ff-113d-42d1-9543-b348a0bb80e3 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.543286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60089c79-cd39-4eb2-b4d3-62719fe760bc None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.564211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e113ff-113d-42d1-9543-b348a0bb80e3 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.583625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c9d2a-99f8-4721-b919-a34f63844169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.584788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c9d2a-99f8-4721-b919-a34f63844169 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.585277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c9d2a-99f8-4721-b919-a34f63844169 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.585875 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c9d2a-99f8-4721-b919-a34f63844169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.594194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c9d2a-99f8-4721-b919-a34f63844169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.596214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c9d2a-99f8-4721-b919-a34f63844169 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.598969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5c34d-f497-41d0-af29-f6249b76b68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.599815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5c34d-f497-41d0-af29-f6249b76b68b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.600088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5c34d-f497-41d0-af29-f6249b76b68b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.600353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5c34d-f497-41d0-af29-f6249b76b68b None admin] PATH_INFO: `/v3/users/swift` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.609652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5c34d-f497-41d0-af29-f6249b76b68b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.611157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5c34d-f497-41d0-af29-f6249b76b68b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.613410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-306c9d2a-99f8-4721-b919-a34f63844169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:35.619554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 313/629] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:35.620623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c9d2a-99f8-4721-b919-a34f63844169 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.626279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-eee5c34d-f497-41d0-af29-f6249b76b68b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 12:41:35.627146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 317/630] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:35.627911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5c34d-f497-41d0-af29-f6249b76b68b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.726739 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c9d2a-99f8-4721-b919-a34f63844169 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.727710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5c34d-f497-41d0-af29-f6249b76b68b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.765408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a43f0-1301-4876-bca6-f4f0c2155a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.766101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a43f0-1301-4876-bca6-f4f0c2155a2b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.766380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a43f0-1301-4876-bca6-f4f0c2155a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.766652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a43f0-1301-4876-bca6-f4f0c2155a2b None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.767441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a43f0-1301-4876-bca6-f4f0c2155a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:35.767744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a43f0-1301-4876-bca6-f4f0c2155a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.769174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a43f0-1301-4876-bca6-f4f0c2155a2b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.770178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea130d1e-dec4-4778-8b67-f217043b2fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.771219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea130d1e-dec4-4778-8b67-f217043b2fb4 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.771700 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea130d1e-dec4-4778-8b67-f217043b2fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.772184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea130d1e-dec4-4778-8b67-f217043b2fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.787966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 318/631] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:35.787966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a43f0-1301-4876-bca6-f4f0c2155a2b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.789748 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea130d1e-dec4-4778-8b67-f217043b2fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.791503 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea130d1e-dec4-4778-8b67-f217043b2fb4 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.813656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-ea130d1e-dec4-4778-8b67-f217043b2fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:35.815302 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 314/632] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:35.817693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea130d1e-dec4-4778-8b67-f217043b2fb4 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.917063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a43f0-1301-4876-bca6-f4f0c2155a2b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.929704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea130d1e-dec4-4778-8b67-f217043b2fb4 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:35.951659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294ca18-f162-4d73-9431-8bb9abc549f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.952350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ca18-f162-4d73-9431-8bb9abc549f5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.952629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ca18-f162-4d73-9431-8bb9abc549f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.953447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ca18-f162-4d73-9431-8bb9abc549f5 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.953802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294ca18-f162-4d73-9431-8bb9abc549f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:35.954113 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294ca18-f162-4d73-9431-8bb9abc549f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.955612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294ca18-f162-4d73-9431-8bb9abc549f5 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.971432 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcba52-c4a1-430c-9549-75c1138c4002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:35.972534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcba52-c4a1-430c-9549-75c1138c4002 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:35.973023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcba52-c4a1-430c-9549-75c1138c4002 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:35.973560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcba52-c4a1-430c-9549-75c1138c4002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:35.974717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcba52-c4a1-430c-9549-75c1138c4002 None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=7330a81c0f3a496ea29ae911fcc69221) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:35.975260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcba52-c4a1-430c-9549-75c1138c4002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:35.976215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 319/633] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:35.977150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294ca18-f162-4d73-9431-8bb9abc549f5 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:35.977470 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcba52-c4a1-430c-9549-75c1138c4002 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:35.993738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 315/634] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/role_assignments?user.id=7330a81c0f3a496ea29ae911fcc69221&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:35.995082 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcba52-c4a1-430c-9549-75c1138c4002 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:36.085687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294ca18-f162-4d73-9431-8bb9abc549f5 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:36.125168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aefe8-a29b-4df8-a264-419726cea2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:36.125876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aefe8-a29b-4df8-a264-419726cea2ae None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.126157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aefe8-a29b-4df8-a264-419726cea2ae None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.126431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aefe8-a29b-4df8-a264-419726cea2ae None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.127159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aefe8-a29b-4df8-a264-419726cea2ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:36.127464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aefe8-a29b-4df8-a264-419726cea2ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:36.128853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aefe8-a29b-4df8-a264-419726cea2ae None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:36.142253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 320/635] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:36.143664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92903302-91f7-49c0-8e57-49c214a3b3c4 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.143952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92903302-91f7-49c0-8e57-49c214a3b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.144227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92903302-91f7-49c0-8e57-49c214a3b3c4 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.149992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 321/636] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:36.151085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92903302-91f7-49c0-8e57-49c214a3b3c4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:36.170363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcba52-c4a1-430c-9549-75c1138c4002 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:36.208441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab89e1e-3496-47ff-8e23-3f81c74760c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:36.209312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab89e1e-3496-47ff-8e23-3f81c74760c8 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.209630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab89e1e-3496-47ff-8e23-3f81c74760c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.209913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab89e1e-3496-47ff-8e23-3f81c74760c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.223012 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab89e1e-3496-47ff-8e23-3f81c74760c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:36.224602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab89e1e-3496-47ff-8e23-3f81c74760c8 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:36.244001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-fab89e1e-3496-47ff-8e23-3f81c74760c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:36.245659 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 316/637] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:36.247209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320d912-3f0b-42f4-adcf-de10f57c002a None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.247209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320d912-3f0b-42f4-adcf-de10f57c002a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.247852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320d912-3f0b-42f4-adcf-de10f57c002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.267022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92903302-91f7-49c0-8e57-49c214a3b3c4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:36.267399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c320d912-3f0b-42f4-adcf-de10f57c002a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:36.268747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c320d912-3f0b-42f4-adcf-de10f57c002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:36.311200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17165d85-aaba-4ae7-9345-67463ed44799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:36.311998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17165d85-aaba-4ae7-9345-67463ed44799 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.312273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17165d85-aaba-4ae7-9345-67463ed44799 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.312826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17165d85-aaba-4ae7-9345-67463ed44799 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.322751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17165d85-aaba-4ae7-9345-67463ed44799 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:36.324249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17165d85-aaba-4ae7-9345-67463ed44799 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:36.340347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-17165d85-aaba-4ae7-9345-67463ed44799 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 12:41:36.342699 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 322/638] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Apr 6 12:41:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:36.343507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17165d85-aaba-4ae7-9345-67463ed44799 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:36.368682 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 317/639] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:36.370041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320d912-3f0b-42f4-adcf-de10f57c002a None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:36.457640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17165d85-aaba-4ae7-9345-67463ed44799 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:36.472343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320d912-3f0b-42f4-adcf-de10f57c002a None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:36.490417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073dd1a-5684-423e-a933-9f6f19ae277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:36.491074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073dd1a-5684-423e-a933-9f6f19ae277a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.491414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073dd1a-5684-423e-a933-9f6f19ae277a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.491693 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073dd1a-5684-423e-a933-9f6f19ae277a None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.492404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073dd1a-5684-423e-a933-9f6f19ae277a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:36.492712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073dd1a-5684-423e-a933-9f6f19ae277a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:36.494108 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073dd1a-5684-423e-a933-9f6f19ae277a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:36.504783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6c4b-5643-4414-bb97-1e4564864acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:36.505448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6c4b-5643-4414-bb97-1e4564864acd None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.505774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6c4b-5643-4414-bb97-1e4564864acd None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.506047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f6c4b-5643-4414-bb97-1e4564864acd None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.506892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6c4b-5643-4414-bb97-1e4564864acd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:36.507200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6c4b-5643-4414-bb97-1e4564864acd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:36.508224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 323/640] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:36.508657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f6c4b-5643-4414-bb97-1e4564864acd None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:36.509824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063bc7-b4ef-40e7-8027-9f0d465a58ec None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.510416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063bc7-b4ef-40e7-8027-9f0d465a58ec None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.510833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063bc7-b4ef-40e7-8027-9f0d465a58ec None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.513983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 324/641] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:36.514881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f063bc7-b4ef-40e7-8027-9f0d465a58ec None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:36.529477 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 318/642] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Apr 6 12:41:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:36.530689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6c4b-5643-4414-bb97-1e4564864acd None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:36.621982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f063bc7-b4ef-40e7-8027-9f0d465a58ec None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:36.635402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f6c4b-5643-4414-bb97-1e4564864acd None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:36.656822 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69273009-ad47-4d51-b154-71279834ad3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:36.657665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69273009-ad47-4d51-b154-71279834ad3b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.657951 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69273009-ad47-4d51-b154-71279834ad3b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.658228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69273009-ad47-4d51-b154-71279834ad3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.669249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69273009-ad47-4d51-b154-71279834ad3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:36.673632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b9097-632a-4860-9db3-ee050a728495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:36.674433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b9097-632a-4860-9db3-ee050a728495 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.674719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b9097-632a-4860-9db3-ee050a728495 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.675252 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b9097-632a-4860-9db3-ee050a728495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.676508 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-69273009-ad47-4d51-b154-71279834ad3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:36.682425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 325/643] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:36.682425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df280a73-742a-4941-8740-abbd68f7e3dc None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.682425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df280a73-742a-4941-8740-abbd68f7e3dc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.682425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df280a73-742a-4941-8740-abbd68f7e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.688047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b9097-632a-4860-9db3-ee050a728495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:36.689528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b9097-632a-4860-9db3-ee050a728495 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:36.697732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-df280a73-742a-4941-8740-abbd68f7e3dc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:36.698888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-df280a73-742a-4941-8740-abbd68f7e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:36.703581 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-0a2b9097-632a-4860-9db3-ee050a728495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:36.709363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 319/644] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:36.709363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b9097-632a-4860-9db3-ee050a728495 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:36.777599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 326/645] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:36.777599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df280a73-742a-4941-8740-abbd68f7e3dc None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:36.828681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b9097-632a-4860-9db3-ee050a728495 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:36.862938 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9eab4-3cc9-48ca-9c42-ae63b108a902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:36.863594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9eab4-3cc9-48ca-9c42-ae63b108a902 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.863877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9eab4-3cc9-48ca-9c42-ae63b108a902 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.864155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9eab4-3cc9-48ca-9c42-ae63b108a902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.879032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df280a73-742a-4941-8740-abbd68f7e3dc None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:36.913704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a91d05-ad21-45f2-b04c-db48d7815224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:36.914364 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91d05-ad21-45f2-b04c-db48d7815224 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:36.914644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91d05-ad21-45f2-b04c-db48d7815224 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:36.914916 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a91d05-ad21-45f2-b04c-db48d7815224 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:36.915671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a91d05-ad21-45f2-b04c-db48d7815224 None admin] RBAC: Adding query filter params (name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:36.915957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a91d05-ad21-45f2-b04c-db48d7815224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:36.917312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a91d05-ad21-45f2-b04c-db48d7815224 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:36.930704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 327/646] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:36.930704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a91d05-ad21-45f2-b04c-db48d7815224 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:36.944983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9eab4-3cc9-48ca-9c42-ae63b108a902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:36.946754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9eab4-3cc9-48ca-9c42-ae63b108a902 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:37.029662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a91d05-ad21-45f2-b04c-db48d7815224 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:37.049483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 320/647] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:37.049483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9eab4-3cc9-48ca-9c42-ae63b108a902 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:37.067906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7d160-4d20-4cab-bcf2-ad8372a2335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:37.068571 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d160-4d20-4cab-bcf2-ad8372a2335e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:37.068858 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d160-4d20-4cab-bcf2-ad8372a2335e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:37.069141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7d160-4d20-4cab-bcf2-ad8372a2335e None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:37.069964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7d160-4d20-4cab-bcf2-ad8372a2335e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:37.070280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7d160-4d20-4cab-bcf2-ad8372a2335e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:37.071738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7d160-4d20-4cab-bcf2-ad8372a2335e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:37.083665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 328/648] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:37.084475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7d160-4d20-4cab-bcf2-ad8372a2335e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:37.148263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9eab4-3cc9-48ca-9c42-ae63b108a902 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:37.180441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13decb-cba9-4c84-95c1-dc507b0fb2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:37.181223 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13decb-cba9-4c84-95c1-dc507b0fb2e9 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:37.181501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13decb-cba9-4c84-95c1-dc507b0fb2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:37.181803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13decb-cba9-4c84-95c1-dc507b0fb2e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:37.186609 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7d160-4d20-4cab-bcf2-ad8372a2335e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:37.192780 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13decb-cba9-4c84-95c1-dc507b0fb2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:37.199740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-9a13decb-cba9-4c84-95c1-dc507b0fb2e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:37.205601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 321/649] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:37.205601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13decb-cba9-4c84-95c1-dc507b0fb2e9 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:37.221189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead2cd2-50b2-4191-9f28-49caa64469d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:37.222153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2cd2-50b2-4191-9f28-49caa64469d9 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:37.222494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2cd2-50b2-4191-9f28-49caa64469d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:37.222848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead2cd2-50b2-4191-9f28-49caa64469d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:37.235486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead2cd2-50b2-4191-9f28-49caa64469d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:37.237170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead2cd2-50b2-4191-9f28-49caa64469d9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:37.255159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-cead2cd2-50b2-4191-9f28-49caa64469d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:37.260713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 329/650] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:37.260713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead2cd2-50b2-4191-9f28-49caa64469d9 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:37.314365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13decb-cba9-4c84-95c1-dc507b0fb2e9 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:37.351579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede4b9-cf6b-406e-9614-229be952fc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:37.352480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede4b9-cf6b-406e-9614-229be952fc80 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:37.352808 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede4b9-cf6b-406e-9614-229be952fc80 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:37.353137 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede4b9-cf6b-406e-9614-229be952fc80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:37.367108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ede4b9-cf6b-406e-9614-229be952fc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:37.368637 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ede4b9-cf6b-406e-9614-229be952fc80 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:37.373728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead2cd2-50b2-4191-9f28-49caa64469d9 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:37.386540 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-03ede4b9-cf6b-406e-9614-229be952fc80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:37.389289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 322/651] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:37.390123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede4b9-cf6b-406e-9614-229be952fc80 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:37.413776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f21d1a-7d83-4016-80ec-c7148d9f2cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:37.414716 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f21d1a-7d83-4016-80ec-c7148d9f2cfc None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:37.414996 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f21d1a-7d83-4016-80ec-c7148d9f2cfc None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:37.415263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f21d1a-7d83-4016-80ec-c7148d9f2cfc None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/0118661184dc4cb198f65e831fb1fe8f/roles/6f21bc5228c14338acc0d1711e7a1742` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:37.430292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f21d1a-7d83-4016-80ec-c7148d9f2cfc None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=0118661184dc4cb198f65e831fb1fe8f, role_id=6f21bc5228c14338acc0d1711e7a1742)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:37.431781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f21d1a-7d83-4016-80ec-c7148d9f2cfc None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:37.461971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 330/652] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:41:37 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/0118661184dc4cb198f65e831fb1fe8f/roles/6f21bc5228c14338acc0d1711e7a1742 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:37.462959 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f21d1a-7d83-4016-80ec-c7148d9f2cfc None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:37.496467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede4b9-cf6b-406e-9614-229be952fc80 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:37.554408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b976a0-7300-460c-a656-e6b92922f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:37.555549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b976a0-7300-460c-a656-e6b92922f613 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:37.556083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b976a0-7300-460c-a656-e6b92922f613 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:37.556587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b976a0-7300-460c-a656-e6b92922f613 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:37.557768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b976a0-7300-460c-a656-e6b92922f613 None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:37.558303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b976a0-7300-460c-a656-e6b92922f613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:37.559965 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b976a0-7300-460c-a656-e6b92922f613 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:37.591225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 323/653] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:37.593790 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b976a0-7300-460c-a656-e6b92922f613 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:37.632359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f21d1a-7d83-4016-80ec-c7148d9f2cfc None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:37.681301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af443-18ea-4bc1-980d-99357a886e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:37.681928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af443-18ea-4bc1-980d-99357a886e1a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:37.683104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af443-18ea-4bc1-980d-99357a886e1a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:37.683104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965af443-18ea-4bc1-980d-99357a886e1a None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:37.683282 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af443-18ea-4bc1-980d-99357a886e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:37.683773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af443-18ea-4bc1-980d-99357a886e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:37.686683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965af443-18ea-4bc1-980d-99357a886e1a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:37.711840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 331/654] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:37.714028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af443-18ea-4bc1-980d-99357a886e1a None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:37.780377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b976a0-7300-460c-a656-e6b92922f613 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:37.814439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cb077-9142-46df-8118-82b318123ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:37.815109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cb077-9142-46df-8118-82b318123ed7 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:37.815393 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cb077-9142-46df-8118-82b318123ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:37.815669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cb077-9142-46df-8118-82b318123ed7 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:37.816398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cb077-9142-46df-8118-82b318123ed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:37.816707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cb077-9142-46df-8118-82b318123ed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:37.818347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cb077-9142-46df-8118-82b318123ed7 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:37.830992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965af443-18ea-4bc1-980d-99357a886e1a None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:37.832754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 324/655] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:37.833683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cb077-9142-46df-8118-82b318123ed7 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:37.866836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e299638-ae73-445c-bd3e-0655ebaaa5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:37.867815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e299638-ae73-445c-bd3e-0655ebaaa5f1 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:37.868109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e299638-ae73-445c-bd3e-0655ebaaa5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:37.869153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e299638-ae73-445c-bd3e-0655ebaaa5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:37.884327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e299638-ae73-445c-bd3e-0655ebaaa5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:37.885875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e299638-ae73-445c-bd3e-0655ebaaa5f1 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:37.909566 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-9e299638-ae73-445c-bd3e-0655ebaaa5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:37.911834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 332/656] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:37.912728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e299638-ae73-445c-bd3e-0655ebaaa5f1 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:37.938043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cb077-9142-46df-8118-82b318123ed7 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:37.972456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390f04e-cc98-46d5-9581-0512a229432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:37.973310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390f04e-cc98-46d5-9581-0512a229432f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:37.973616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390f04e-cc98-46d5-9581-0512a229432f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:37.973904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390f04e-cc98-46d5-9581-0512a229432f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:37.981603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390f04e-cc98-46d5-9581-0512a229432f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:37.983255 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390f04e-cc98-46d5-9581-0512a229432f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:37.997350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-2390f04e-cc98-46d5-9581-0512a229432f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 12:41:37.998892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 325/657] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:37.999670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390f04e-cc98-46d5-9581-0512a229432f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:38.033435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e299638-ae73-445c-bd3e-0655ebaaa5f1 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:38.074445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ef345-47dc-44be-8931-fd2c6c52bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:38.076178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef345-47dc-44be-8931-fd2c6c52bba0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.076452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef345-47dc-44be-8931-fd2c6c52bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.076725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ef345-47dc-44be-8931-fd2c6c52bba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.085452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ef345-47dc-44be-8931-fd2c6c52bba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:38.087220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ef345-47dc-44be-8931-fd2c6c52bba0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:38.103391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-9e7ef345-47dc-44be-8931-fd2c6c52bba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:38.104353 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390f04e-cc98-46d5-9581-0512a229432f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:38.104908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 333/658] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:38.105767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ef345-47dc-44be-8931-fd2c6c52bba0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:38.147096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b025-9137-47a4-a45f-7982deafe7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:38.147822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b025-9137-47a4-a45f-7982deafe7e1 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.148502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b025-9137-47a4-a45f-7982deafe7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.148791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88b025-9137-47a4-a45f-7982deafe7e1 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.149855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88b025-9137-47a4-a45f-7982deafe7e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:38.150171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88b025-9137-47a4-a45f-7982deafe7e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:38.152025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88b025-9137-47a4-a45f-7982deafe7e1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:38.167024 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 326/659] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:38.168315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b025-9137-47a4-a45f-7982deafe7e1 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:38.223734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ef345-47dc-44be-8931-fd2c6c52bba0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:38.272286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4f025-0cd4-4330-958f-fca9427b15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:38.273219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4f025-0cd4-4330-958f-fca9427b15a2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.273503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4f025-0cd4-4330-958f-fca9427b15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.273805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4f025-0cd4-4330-958f-fca9427b15a2 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.274652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4f025-0cd4-4330-958f-fca9427b15a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:38.274844 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88b025-9137-47a4-a45f-7982deafe7e1 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:38.274992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4f025-0cd4-4330-958f-fca9427b15a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:38.276546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4f025-0cd4-4330-958f-fca9427b15a2 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:38.302826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 334/660] 10.222.0.23 () {56 vars in 1137 bytes} [Wed Apr 6 12:41:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:38.304191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4f025-0cd4-4330-958f-fca9427b15a2 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:38.319650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930aec-e383-4712-ac5f-41132949a500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:38.320549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930aec-e383-4712-ac5f-41132949a500 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.321130 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930aec-e383-4712-ac5f-41132949a500 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.321604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930aec-e383-4712-ac5f-41132949a500 None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.323150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95930aec-e383-4712-ac5f-41132949a500 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:38.332119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95930aec-e383-4712-ac5f-41132949a500 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:38.333650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95930aec-e383-4712-ac5f-41132949a500 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:38.355715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 327/661] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:38.356730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930aec-e383-4712-ac5f-41132949a500 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:38.415203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4f025-0cd4-4330-958f-fca9427b15a2 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:38.449112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371b4c9-71d0-44f5-863e-fd3782380a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:38.450550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371b4c9-71d0-44f5-863e-fd3782380a99 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.451070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371b4c9-71d0-44f5-863e-fd3782380a99 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.451446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371b4c9-71d0-44f5-863e-fd3782380a99 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.458837 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371b4c9-71d0-44f5-863e-fd3782380a99 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:38.460293 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371b4c9-71d0-44f5-863e-fd3782380a99 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:38.460620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930aec-e383-4712-ac5f-41132949a500 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:38.474207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-3371b4c9-71d0-44f5-863e-fd3782380a99 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 06 12:41:38.475703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 335/662] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:38.476551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371b4c9-71d0-44f5-863e-fd3782380a99 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:38.494439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bcce2-3e5a-4592-a795-68e4aa9b71eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:38.495092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bcce2-3e5a-4592-a795-68e4aa9b71eb None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.495372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bcce2-3e5a-4592-a795-68e4aa9b71eb None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.495645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bcce2-3e5a-4592-a795-68e4aa9b71eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.563005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bcce2-3e5a-4592-a795-68e4aa9b71eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:38.564513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bcce2-3e5a-4592-a795-68e4aa9b71eb None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:38.576631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371b4c9-71d0-44f5-863e-fd3782380a99 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:38.610767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c395d3-443a-4c1f-840c-e1f1b7b5732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:38.611432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c395d3-443a-4c1f-840c-e1f1b7b5732c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.611717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c395d3-443a-4c1f-840c-e1f1b7b5732c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.611994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c395d3-443a-4c1f-840c-e1f1b7b5732c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.612825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c395d3-443a-4c1f-840c-e1f1b7b5732c None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=65b295446c7741ea96caf60ac955d82d) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:38.613134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c395d3-443a-4c1f-840c-e1f1b7b5732c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:38.614588 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c395d3-443a-4c1f-840c-e1f1b7b5732c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:38.620849 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 336/663] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:38 2022] GET /identity/v3/role_assignments?user.id=65b295446c7741ea96caf60ac955d82d&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:38.621845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c395d3-443a-4c1f-840c-e1f1b7b5732c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:38.681560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 328/664] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:38.683186 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5f34-8b99-4d56-bcef-a03cc48d77bd None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.683476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5f34-8b99-4d56-bcef-a03cc48d77bd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.683754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5f34-8b99-4d56-bcef-a03cc48d77bd None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.686431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 329/665] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:38.687212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a5f34-8b99-4d56-bcef-a03cc48d77bd None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:38.731598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c395d3-443a-4c1f-840c-e1f1b7b5732c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:38.767944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe166c90-72a6-4b4f-9ed8-22abbe4cfc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:38.768639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe166c90-72a6-4b4f-9ed8-22abbe4cfc92 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.768920 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe166c90-72a6-4b4f-9ed8-22abbe4cfc92 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.769196 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe166c90-72a6-4b4f-9ed8-22abbe4cfc92 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.770102 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe166c90-72a6-4b4f-9ed8-22abbe4cfc92 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:38.770412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe166c90-72a6-4b4f-9ed8-22abbe4cfc92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:38.771877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe166c90-72a6-4b4f-9ed8-22abbe4cfc92 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:38.791316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 337/666] 10.222.0.23 () {56 vars in 1139 bytes} [Wed Apr 6 12:41:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:38.792818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49e9d6-82cf-4cdc-9acb-5fd125505e1a None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.793110 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49e9d6-82cf-4cdc-9acb-5fd125505e1a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.793970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49e9d6-82cf-4cdc-9acb-5fd125505e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.796582 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a5f34-8b99-4d56-bcef-a03cc48d77bd None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:38.811732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-4b49e9d6-82cf-4cdc-9acb-5fd125505e1a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:38.812953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4b49e9d6-82cf-4cdc-9acb-5fd125505e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:38.837793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e824a2b-7f96-40ea-88ac-a5db5c7a0ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:38.839037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e824a2b-7f96-40ea-88ac-a5db5c7a0ea5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:38.839370 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e824a2b-7f96-40ea-88ac-a5db5c7a0ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:38.839844 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e824a2b-7f96-40ea-88ac-a5db5c7a0ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:38.852103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e824a2b-7f96-40ea-88ac-a5db5c7a0ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:38.854270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e824a2b-7f96-40ea-88ac-a5db5c7a0ea5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:38.878197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-3e824a2b-7f96-40ea-88ac-a5db5c7a0ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:38.879812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 330/667] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:38.880895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e824a2b-7f96-40ea-88ac-a5db5c7a0ea5 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:38.911111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 338/668] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:38.912668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49e9d6-82cf-4cdc-9acb-5fd125505e1a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:38.996160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e824a2b-7f96-40ea-88ac-a5db5c7a0ea5 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.030932 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d0467-05af-4e9c-b050-73e04f70a210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:39.032228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49e9d6-82cf-4cdc-9acb-5fd125505e1a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.032414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d0467-05af-4e9c-b050-73e04f70a210 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:39.032888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d0467-05af-4e9c-b050-73e04f70a210 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:39.033347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d0467-05af-4e9c-b050-73e04f70a210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:39.074506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f3458-c981-44c8-80cd-31e88c83bdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:39.075619 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3458-c981-44c8-80cd-31e88c83bdb6 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:39.075981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3458-c981-44c8-80cd-31e88c83bdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:39.076341 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f3458-c981-44c8-80cd-31e88c83bdb6 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:39.077441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f3458-c981-44c8-80cd-31e88c83bdb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:39.077780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f3458-c981-44c8-80cd-31e88c83bdb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:39.079804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f3458-c981-44c8-80cd-31e88c83bdb6 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:39.096049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 339/669] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:39.097094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f3458-c981-44c8-80cd-31e88c83bdb6 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:39.109772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d0467-05af-4e9c-b050-73e04f70a210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:39.111820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d0467-05af-4e9c-b050-73e04f70a210 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:39.211579 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f3458-c981-44c8-80cd-31e88c83bdb6 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.221515 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 331/670] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:39.222754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d0467-05af-4e9c-b050-73e04f70a210 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:39.251666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dd12e-0614-47c1-bfc8-1ba16363a8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:39.252796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dd12e-0614-47c1-bfc8-1ba16363a8a9 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:39.253276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dd12e-0614-47c1-bfc8-1ba16363a8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:39.253821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dd12e-0614-47c1-bfc8-1ba16363a8a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:39.264169 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dd12e-0614-47c1-bfc8-1ba16363a8a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:39.265931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dd12e-0614-47c1-bfc8-1ba16363a8a9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:39.284040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-da6dd12e-0614-47c1-bfc8-1ba16363a8a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:39.285994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 340/671] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:39.287028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dd12e-0614-47c1-bfc8-1ba16363a8a9 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:39.338803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d0467-05af-4e9c-b050-73e04f70a210 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.373863 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ece35-5f16-4b42-a079-99b73eec1384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:39.374991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ece35-5f16-4b42-a079-99b73eec1384 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:39.375497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ece35-5f16-4b42-a079-99b73eec1384 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:39.375983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ece35-5f16-4b42-a079-99b73eec1384 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:39.383045 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ece35-5f16-4b42-a079-99b73eec1384 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:39.384752 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ece35-5f16-4b42-a079-99b73eec1384 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:39.398021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-fd2ece35-5f16-4b42-a079-99b73eec1384 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:39.399825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 332/672] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:39.400183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dd12e-0614-47c1-bfc8-1ba16363a8a9 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.401124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ece35-5f16-4b42-a079-99b73eec1384 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:39.440806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdba650-1c79-45a8-a9c2-a2898d5f4a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:39.441978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdba650-1c79-45a8-a9c2-a2898d5f4a7e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:39.442457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdba650-1c79-45a8-a9c2-a2898d5f4a7e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:39.442946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdba650-1c79-45a8-a9c2-a2898d5f4a7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:39.453263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdba650-1c79-45a8-a9c2-a2898d5f4a7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:39.455120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdba650-1c79-45a8-a9c2-a2898d5f4a7e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:39.472725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-dbdba650-1c79-45a8-a9c2-a2898d5f4a7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:39.478856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 341/673] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:39.480050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdba650-1c79-45a8-a9c2-a2898d5f4a7e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:39.524304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ece35-5f16-4b42-a079-99b73eec1384 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.569551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba19e7b-635d-4b92-af14-c013bdea9ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:39.570617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba19e7b-635d-4b92-af14-c013bdea9ea8 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:39.570993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba19e7b-635d-4b92-af14-c013bdea9ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:39.571280 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba19e7b-635d-4b92-af14-c013bdea9ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:39.572040 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba19e7b-635d-4b92-af14-c013bdea9ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:39.572349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba19e7b-635d-4b92-af14-c013bdea9ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:39.573901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba19e7b-635d-4b92-af14-c013bdea9ea8 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:39.588276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdba650-1c79-45a8-a9c2-a2898d5f4a7e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.591772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 333/674] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:39.592706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba19e7b-635d-4b92-af14-c013bdea9ea8 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:39.627135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a93e29-2af2-467c-8dc8-ea359cb4efac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:39.628058 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a93e29-2af2-467c-8dc8-ea359cb4efac None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:39.628411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a93e29-2af2-467c-8dc8-ea359cb4efac None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:39.628792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a93e29-2af2-467c-8dc8-ea359cb4efac None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:39.629713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a93e29-2af2-467c-8dc8-ea359cb4efac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:39.630060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a93e29-2af2-467c-8dc8-ea359cb4efac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:39.631515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a93e29-2af2-467c-8dc8-ea359cb4efac None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:39.645766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 342/675] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:39.646679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a93e29-2af2-467c-8dc8-ea359cb4efac None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:39.709601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba19e7b-635d-4b92-af14-c013bdea9ea8 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.744686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4ac6-614e-42f9-8043-799d95bb6137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:39.745377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4ac6-614e-42f9-8043-799d95bb6137 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:39.745823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4ac6-614e-42f9-8043-799d95bb6137 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:39.746127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4ac6-614e-42f9-8043-799d95bb6137 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:39.747410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f4ac6-614e-42f9-8043-799d95bb6137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:39.747725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f4ac6-614e-42f9-8043-799d95bb6137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:39.749177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f4ac6-614e-42f9-8043-799d95bb6137 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:39.764917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 334/676] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:39.765110 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a93e29-2af2-467c-8dc8-ea359cb4efac None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.765838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4ac6-614e-42f9-8043-799d95bb6137 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:39.801137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd4ba4-3461-4924-89ca-b2766311a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:39.801811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd4ba4-3461-4924-89ca-b2766311a33e None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:39.802094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd4ba4-3461-4924-89ca-b2766311a33e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:39.802368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd4ba4-3461-4924-89ca-b2766311a33e None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:39.803123 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd4ba4-3461-4924-89ca-b2766311a33e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:39.804612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd4ba4-3461-4924-89ca-b2766311a33e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:39.830929 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 343/677] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:41:39 2022] POST /identity/v3/users => generated 254 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:41:39.831897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd4ba4-3461-4924-89ca-b2766311a33e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:39.940289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4ac6-614e-42f9-8043-799d95bb6137 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.961065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd4ba4-3461-4924-89ca-b2766311a33e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:39.980349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45fbd0-3e9a-498e-8d5f-a9635f721615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:39.981257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45fbd0-3e9a-498e-8d5f-a9635f721615 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:39.981591 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45fbd0-3e9a-498e-8d5f-a9635f721615 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:39.981909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45fbd0-3e9a-498e-8d5f-a9635f721615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:39.982833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45fbd0-3e9a-498e-8d5f-a9635f721615 None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=7277fd0f4cf64df4aaa65d7743b99028) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:39.983145 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45fbd0-3e9a-498e-8d5f-a9635f721615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:39.984641 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45fbd0-3e9a-498e-8d5f-a9635f721615 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:39.991654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 335/678] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:39 2022] GET /identity/v3/role_assignments?user.id=7277fd0f4cf64df4aaa65d7743b99028&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:40.001642 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818644df-01c2-4122-9dd7-616f918e8428 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:40.002143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818644df-01c2-4122-9dd7-616f918e8428 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:40.002651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818644df-01c2-4122-9dd7-616f918e8428 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:40.009620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8247d-0d16-4cfb-82f3-2d589a99841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:40.009876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 336/679] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:40.011026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8247d-0d16-4cfb-82f3-2d589a99841c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:40.011320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a76b2-ef92-4219-a680-f17dc52bd33c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:40.011607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a76b2-ef92-4219-a680-f17dc52bd33c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:40.011752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8247d-0d16-4cfb-82f3-2d589a99841c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:40.011890 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a76b2-ef92-4219-a680-f17dc52bd33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:40.012900 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8247d-0d16-4cfb-82f3-2d589a99841c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:40.021447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8247d-0d16-4cfb-82f3-2d589a99841c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:40.023387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8247d-0d16-4cfb-82f3-2d589a99841c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:40.040304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-9ad8247d-0d16-4cfb-82f3-2d589a99841c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:40.043258 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 344/680] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:40.052456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c23a76b2-ef92-4219-a680-f17dc52bd33c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:40.052456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c23a76b2-ef92-4219-a680-f17dc52bd33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:40.054801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8247d-0d16-4cfb-82f3-2d589a99841c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:40.155928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 337/681] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:40.188768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8247d-0d16-4cfb-82f3-2d589a99841c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:40.191729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a76b2-ef92-4219-a680-f17dc52bd33c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:40.237616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb01c38-6353-4adf-9fc3-b8656f6829ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:40.238354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb01c38-6353-4adf-9fc3-b8656f6829ae None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:40.238636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb01c38-6353-4adf-9fc3-b8656f6829ae None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:40.238909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb01c38-6353-4adf-9fc3-b8656f6829ae None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:40.240281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb01c38-6353-4adf-9fc3-b8656f6829ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:40.240281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb01c38-6353-4adf-9fc3-b8656f6829ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:40.243394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb01c38-6353-4adf-9fc3-b8656f6829ae None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:40.257625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 345/682] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:40.262856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb01c38-6353-4adf-9fc3-b8656f6829ae None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:40.331056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a76b2-ef92-4219-a680-f17dc52bd33c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:40.376209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7530-e97c-4263-a63b-8475376de423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:40.377008 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7530-e97c-4263-a63b-8475376de423 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:40.377286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7530-e97c-4263-a63b-8475376de423 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:40.377558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee7530-e97c-4263-a63b-8475376de423 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:40.391764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee7530-e97c-4263-a63b-8475376de423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:40.393519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb01c38-6353-4adf-9fc3-b8656f6829ae None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:40.398876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-4fee7530-e97c-4263-a63b-8475376de423 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:40.400387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 338/683] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:40.406035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7530-e97c-4263-a63b-8475376de423 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:40.429294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0eca8-3201-4519-97a4-45308430183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:40.430376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0eca8-3201-4519-97a4-45308430183e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:40.430874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0eca8-3201-4519-97a4-45308430183e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:40.431340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0eca8-3201-4519-97a4-45308430183e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:40.432384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0eca8-3201-4519-97a4-45308430183e None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=7bd327cdfe2c4f729252d86838aae638) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:40.432905 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0eca8-3201-4519-97a4-45308430183e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:40.434684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0eca8-3201-4519-97a4-45308430183e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:40.441493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 346/684] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:40 2022] GET /identity/v3/role_assignments?user.id=7bd327cdfe2c4f729252d86838aae638&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:40.511455 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee7530-e97c-4263-a63b-8475376de423 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:40.553610 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c62140-1868-4099-ba0b-84e73ad41eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:40.554320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c62140-1868-4099-ba0b-84e73ad41eac None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:40.554599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c62140-1868-4099-ba0b-84e73ad41eac None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:40.554873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c62140-1868-4099-ba0b-84e73ad41eac None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:40.555646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c62140-1868-4099-ba0b-84e73ad41eac None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:40.555951 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c62140-1868-4099-ba0b-84e73ad41eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:40.557406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c62140-1868-4099-ba0b-84e73ad41eac None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:40.566882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 339/685] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:40.572761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0eca8-3201-4519-97a4-45308430183e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:40.742049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0eca8-3201-4519-97a4-45308430183e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:40.788241 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3ed0-e86f-46e3-8d71-d7b064ce0652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:40.789036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3ed0-e86f-46e3-8d71-d7b064ce0652 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:40.789316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3ed0-e86f-46e3-8d71-d7b064ce0652 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:40.789606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3ed0-e86f-46e3-8d71-d7b064ce0652 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:40.807646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef3ed0-e86f-46e3-8d71-d7b064ce0652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:40.809666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef3ed0-e86f-46e3-8d71-d7b064ce0652 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:40.828662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-45ef3ed0-e86f-46e3-8d71-d7b064ce0652 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:40.830253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 347/686] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:40.835464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c62140-1868-4099-ba0b-84e73ad41eac None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:40.955122 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c62140-1868-4099-ba0b-84e73ad41eac None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:40.991579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c684414-f71b-44f0-9dbc-2bf162d88fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:40.992311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c684414-f71b-44f0-9dbc-2bf162d88fcf None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:40.992535 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c684414-f71b-44f0-9dbc-2bf162d88fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:40.992809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c684414-f71b-44f0-9dbc-2bf162d88fcf None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:40.993536 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c684414-f71b-44f0-9dbc-2bf162d88fcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:40.993866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c684414-f71b-44f0-9dbc-2bf162d88fcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:40.995258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c684414-f71b-44f0-9dbc-2bf162d88fcf None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:41.008295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 340/687] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:41.013837 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3ed0-e86f-46e3-8d71-d7b064ce0652 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:41.141728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3ed0-e86f-46e3-8d71-d7b064ce0652 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:41.186803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38850113-0f61-4801-a767-4bd5a8b89c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:41.187603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850113-0f61-4801-a767-4bd5a8b89c31 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:41.187885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850113-0f61-4801-a767-4bd5a8b89c31 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:41.188161 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38850113-0f61-4801-a767-4bd5a8b89c31 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:41.201074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38850113-0f61-4801-a767-4bd5a8b89c31 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:41.202532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38850113-0f61-4801-a767-4bd5a8b89c31 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:41.219392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-38850113-0f61-4801-a767-4bd5a8b89c31 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 12:41:41.220979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 348/688] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:41.226294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c684414-f71b-44f0-9dbc-2bf162d88fcf None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:41.285469 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c5118-1039-4a7b-be6a-51348a07d681 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:41.285843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c5118-1039-4a7b-be6a-51348a07d681 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:41.286082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c5118-1039-4a7b-be6a-51348a07d681 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:41.287692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 349/689] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:41:41.293991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbbcda-c413-4430-8a96-2b91317d672d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:41.294270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbbcda-c413-4430-8a96-2b91317d672d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:41.294541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbbcda-c413-4430-8a96-2b91317d672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:41.315747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-0dbbbcda-c413-4430-8a96-2b91317d672d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:41.316985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0dbbbcda-c413-4430-8a96-2b91317d672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:41.391787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 350/690] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:41.419219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbbcda-c413-4430-8a96-2b91317d672d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:41.438144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c684414-f71b-44f0-9dbc-2bf162d88fcf None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:41.507720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df05a24-2cc1-4a3b-9a1a-4ebddf97a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:41.508395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df05a24-2cc1-4a3b-9a1a-4ebddf97a262 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:41.508673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df05a24-2cc1-4a3b-9a1a-4ebddf97a262 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:41.508946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df05a24-2cc1-4a3b-9a1a-4ebddf97a262 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:41.509809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df05a24-2cc1-4a3b-9a1a-4ebddf97a262 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:41.510117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df05a24-2cc1-4a3b-9a1a-4ebddf97a262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:41.511561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df05a24-2cc1-4a3b-9a1a-4ebddf97a262 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:41.549433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 341/691] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Apr 6 12:41:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:41.555819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df05a24-2cc1-4a3b-9a1a-4ebddf97a262 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:41.617147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbbcda-c413-4430-8a96-2b91317d672d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:41.682930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df05a24-2cc1-4a3b-9a1a-4ebddf97a262 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:41.699278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299f0a-484d-4876-ae76-7ec00f1668d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:41.701040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299f0a-484d-4876-ae76-7ec00f1668d2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:41.701539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299f0a-484d-4876-ae76-7ec00f1668d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:41.702023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88299f0a-484d-4876-ae76-7ec00f1668d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:41.720623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca03b3-0909-450b-a70a-f5a6b72b24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:41.721280 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca03b3-0909-450b-a70a-f5a6b72b24be None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:41.721561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca03b3-0909-450b-a70a-f5a6b72b24be None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:41.721859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca03b3-0909-450b-a70a-f5a6b72b24be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:41.731842 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88299f0a-484d-4876-ae76-7ec00f1668d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:41.740262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-88299f0a-484d-4876-ae76-7ec00f1668d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:41:41.741846 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 351/692] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:41.748791 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299f0a-484d-4876-ae76-7ec00f1668d2 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:41.867477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88299f0a-484d-4876-ae76-7ec00f1668d2 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:41.890696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca03b3-0909-450b-a70a-f5a6b72b24be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:41.892213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca03b3-0909-450b-a70a-f5a6b72b24be None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:41.904900 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bd36b-1601-46c8-b62d-0516bf897566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:41.905603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bd36b-1601-46c8-b62d-0516bf897566 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:41.905878 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bd36b-1601-46c8-b62d-0516bf897566 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:41.906151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bd36b-1601-46c8-b62d-0516bf897566 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:41.906904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bd36b-1601-46c8-b62d-0516bf897566 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:41.907208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bd36b-1601-46c8-b62d-0516bf897566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:41.909037 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bd36b-1601-46c8-b62d-0516bf897566 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:41.918953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 352/693] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:41.924349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bd36b-1601-46c8-b62d-0516bf897566 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:42.035592 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bd36b-1601-46c8-b62d-0516bf897566 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:42.072758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f139766-5b69-4291-94bd-c17e667a822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:42.073890 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f139766-5b69-4291-94bd-c17e667a822f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:42.074168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f139766-5b69-4291-94bd-c17e667a822f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:42.074436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f139766-5b69-4291-94bd-c17e667a822f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:42.087355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f139766-5b69-4291-94bd-c17e667a822f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:42.088973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f139766-5b69-4291-94bd-c17e667a822f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:42.108691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-3f139766-5b69-4291-94bd-c17e667a822f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:42.110271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 353/694] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:42.116312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f139766-5b69-4291-94bd-c17e667a822f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:42.130087 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 342/695] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:42.135389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca03b3-0909-450b-a70a-f5a6b72b24be None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:42.219806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f139766-5b69-4291-94bd-c17e667a822f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:42.252927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca03b3-0909-450b-a70a-f5a6b72b24be None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:42.254909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbde5e-b6cc-451c-b3bc-9ee973c0c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:42.255591 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbde5e-b6cc-451c-b3bc-9ee973c0c0c3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:42.255872 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbde5e-b6cc-451c-b3bc-9ee973c0c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:42.256148 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbde5e-b6cc-451c-b3bc-9ee973c0c0c3 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:42.256883 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbde5e-b6cc-451c-b3bc-9ee973c0c0c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:42.257187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbde5e-b6cc-451c-b3bc-9ee973c0c0c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:42.258633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbde5e-b6cc-451c-b3bc-9ee973c0c0c3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:42.273016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 354/696] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:42.278512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbde5e-b6cc-451c-b3bc-9ee973c0c0c3 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:42.320387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0795f35-9c10-4ab7-844f-99a23b8bfe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:42.321213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0795f35-9c10-4ab7-844f-99a23b8bfe0d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:42.321498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0795f35-9c10-4ab7-844f-99a23b8bfe0d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:42.321801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0795f35-9c10-4ab7-844f-99a23b8bfe0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:42.340286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0795f35-9c10-4ab7-844f-99a23b8bfe0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:42.341722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0795f35-9c10-4ab7-844f-99a23b8bfe0d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:42.370996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-d0795f35-9c10-4ab7-844f-99a23b8bfe0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:42.373303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 343/697] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:42.378801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0795f35-9c10-4ab7-844f-99a23b8bfe0d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:42.389417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbde5e-b6cc-451c-b3bc-9ee973c0c0c3 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:42.425984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c841df-6055-4abf-bcc0-fe76daea136b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:42.426776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c841df-6055-4abf-bcc0-fe76daea136b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:42.427054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c841df-6055-4abf-bcc0-fe76daea136b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:42.427372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c841df-6055-4abf-bcc0-fe76daea136b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:42.434908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c841df-6055-4abf-bcc0-fe76daea136b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:42.436358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c841df-6055-4abf-bcc0-fe76daea136b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:42.450871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-a4c841df-6055-4abf-bcc0-fe76daea136b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 12:41:42.452384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 355/698] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Apr 6 12:41:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:42.457698 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c841df-6055-4abf-bcc0-fe76daea136b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:42.561841 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c841df-6055-4abf-bcc0-fe76daea136b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:42.590626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0795f35-9c10-4ab7-844f-99a23b8bfe0d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:42.601362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da67f6-4f5d-4c34-b8b5-7f4320ec66bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:42.602055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da67f6-4f5d-4c34-b8b5-7f4320ec66bd None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:42.602333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da67f6-4f5d-4c34-b8b5-7f4320ec66bd None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:42.602600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da67f6-4f5d-4c34-b8b5-7f4320ec66bd None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:42.603437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da67f6-4f5d-4c34-b8b5-7f4320ec66bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:42.603738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da67f6-4f5d-4c34-b8b5-7f4320ec66bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:42.605171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da67f6-4f5d-4c34-b8b5-7f4320ec66bd None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:42.634629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 356/699] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Apr 6 12:41:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:42.640071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da67f6-4f5d-4c34-b8b5-7f4320ec66bd None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:42.646846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7dd39-08bb-47b1-8013-d14ec0b01be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:42.647510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7dd39-08bb-47b1-8013-d14ec0b01be3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:42.647789 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7dd39-08bb-47b1-8013-d14ec0b01be3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:42.648060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7dd39-08bb-47b1-8013-d14ec0b01be3 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:42.649629 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7dd39-08bb-47b1-8013-d14ec0b01be3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:42.649947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7dd39-08bb-47b1-8013-d14ec0b01be3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:42.651343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7dd39-08bb-47b1-8013-d14ec0b01be3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:42.663786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 344/700] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:42.669104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7dd39-08bb-47b1-8013-d14ec0b01be3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:42.773638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da67f6-4f5d-4c34-b8b5-7f4320ec66bd None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:42.776791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7dd39-08bb-47b1-8013-d14ec0b01be3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:42.809546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d0f99-3bb6-45da-9c82-15d60f4d8b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:42.810667 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d0f99-3bb6-45da-9c82-15d60f4d8b98 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:42.811114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d0f99-3bb6-45da-9c82-15d60f4d8b98 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:42.811525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d0f99-3bb6-45da-9c82-15d60f4d8b98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:42.811635 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7dcc0-9fb3-4dd9-9332-4783674423d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:42.812353 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7dcc0-9fb3-4dd9-9332-4783674423d3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:42.812637 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7dcc0-9fb3-4dd9-9332-4783674423d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:42.812941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7dcc0-9fb3-4dd9-9332-4783674423d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:42.819793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7dcc0-9fb3-4dd9-9332-4783674423d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:42.821266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7dcc0-9fb3-4dd9-9332-4783674423d3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:42.835559 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-45e7dcc0-9fb3-4dd9-9332-4783674423d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:42.841725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 345/701] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:42.843152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe90e5d-e425-4e69-acf1-f7724c389ae1 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:42.843444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe90e5d-e425-4e69-acf1-f7724c389ae1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:42.843720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe90e5d-e425-4e69-acf1-f7724c389ae1 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:42.849096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 346/702] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:42.849096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe90e5d-e425-4e69-acf1-f7724c389ae1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:42.887922 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d0f99-3bb6-45da-9c82-15d60f4d8b98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:42.889698 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d0f99-3bb6-45da-9c82-15d60f4d8b98 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:42.960666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe90e5d-e425-4e69-acf1-f7724c389ae1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:42.998271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 357/703] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:42.998271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8bcb4-a905-4629-92cf-80ac1769b27a None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:42.998271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8bcb4-a905-4629-92cf-80ac1769b27a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:42.998271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8bcb4-a905-4629-92cf-80ac1769b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:42.999870 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf4b7-c1e1-4c03-995d-822be9e58713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:43.000545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf4b7-c1e1-4c03-995d-822be9e58713 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.000830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf4b7-c1e1-4c03-995d-822be9e58713 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.001109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf4b7-c1e1-4c03-995d-822be9e58713 None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.001937 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adf4b7-c1e1-4c03-995d-822be9e58713 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:43.002250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adf4b7-c1e1-4c03-995d-822be9e58713 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:43.003725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adf4b7-c1e1-4c03-995d-822be9e58713 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:43.015244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-73d8bcb4-a905-4629-92cf-80ac1769b27a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:43.015713 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 347/704] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:43.017100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd761-32d4-4be3-aa82-0bdf1963b3b1 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.017395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd761-32d4-4be3-aa82-0bdf1963b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.017705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd761-32d4-4be3-aa82-0bdf1963b3b1 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.019000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-73d8bcb4-a905-4629-92cf-80ac1769b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:43.023552 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 348/705] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:43.024512 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd761-32d4-4be3-aa82-0bdf1963b3b1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:43.090707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 358/706] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:43.092143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8bcb4-a905-4629-92cf-80ac1769b27a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:43.156512 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd761-32d4-4be3-aa82-0bdf1963b3b1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:43.191650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8bcb4-a905-4629-92cf-80ac1769b27a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:43.191866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4e183-e23a-4b58-8e2f-a7fd66c37ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:43.192612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e183-e23a-4b58-8e2f-a7fd66c37ae8 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.192893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e183-e23a-4b58-8e2f-a7fd66c37ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.193159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4e183-e23a-4b58-8e2f-a7fd66c37ae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.204337 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4e183-e23a-4b58-8e2f-a7fd66c37ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:43.205873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4e183-e23a-4b58-8e2f-a7fd66c37ae8 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:43.222424 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-97d4e183-e23a-4b58-8e2f-a7fd66c37ae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:43.227910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 349/707] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:43.227910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26435ef-414c-4e0d-9669-38b254b5554f None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.227910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26435ef-414c-4e0d-9669-38b254b5554f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.227910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26435ef-414c-4e0d-9669-38b254b5554f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.229860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f98188-6efd-47cb-8022-99fbf4b89a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:43.230518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98188-6efd-47cb-8022-99fbf4b89a47 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.231357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98188-6efd-47cb-8022-99fbf4b89a47 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.231700 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98188-6efd-47cb-8022-99fbf4b89a47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.232678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f98188-6efd-47cb-8022-99fbf4b89a47 None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=0118661184dc4cb198f65e831fb1fe8f) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:43.232846 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f98188-6efd-47cb-8022-99fbf4b89a47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:43.234321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f98188-6efd-47cb-8022-99fbf4b89a47 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:43.240264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 359/708] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:43 2022] GET /identity/v3/role_assignments?user.id=0118661184dc4cb198f65e831fb1fe8f&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:43.241039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f98188-6efd-47cb-8022-99fbf4b89a47 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:43.256022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b26435ef-414c-4e0d-9669-38b254b5554f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:43.258281 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b26435ef-414c-4e0d-9669-38b254b5554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:43.358309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f98188-6efd-47cb-8022-99fbf4b89a47 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:43.373716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 350/709] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:43.375452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26435ef-414c-4e0d-9669-38b254b5554f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:43.419163 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b4f6b-2a64-4e99-9539-a368d1365186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:43.420062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b4f6b-2a64-4e99-9539-a368d1365186 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.420346 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b4f6b-2a64-4e99-9539-a368d1365186 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.420621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b4f6b-2a64-4e99-9539-a368d1365186 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.433358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b4f6b-2a64-4e99-9539-a368d1365186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:43.441725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-835b4f6b-2a64-4e99-9539-a368d1365186 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:43.445664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 360/710] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:43.446627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b4f6b-2a64-4e99-9539-a368d1365186 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:43.531405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26435ef-414c-4e0d-9669-38b254b5554f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:43.571296 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e47788-5da7-43a1-8e5e-ecc49831f7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:43.572074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e47788-5da7-43a1-8e5e-ecc49831f7c6 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.572431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e47788-5da7-43a1-8e5e-ecc49831f7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.572774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e47788-5da7-43a1-8e5e-ecc49831f7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.573621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e47788-5da7-43a1-8e5e-ecc49831f7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:43.574022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e47788-5da7-43a1-8e5e-ecc49831f7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:43.575772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e47788-5da7-43a1-8e5e-ecc49831f7c6 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:43.579754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b4f6b-2a64-4e99-9539-a368d1365186 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:43.594202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 351/711] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:43.595289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e47788-5da7-43a1-8e5e-ecc49831f7c6 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:43.631736 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3893c-aebb-407e-8ed2-9cc11b802c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:43.632638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3893c-aebb-407e-8ed2-9cc11b802c17 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.632923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3893c-aebb-407e-8ed2-9cc11b802c17 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.633196 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3893c-aebb-407e-8ed2-9cc11b802c17 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.633940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3893c-aebb-407e-8ed2-9cc11b802c17 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:43.635390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3893c-aebb-407e-8ed2-9cc11b802c17 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:43.652127 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-84e3893c-aebb-407e-8ed2-9cc11b802c17 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 06 12:41:43.654393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 361/712] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Apr 6 12:41:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:43.655247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3893c-aebb-407e-8ed2-9cc11b802c17 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:43.710234 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e47788-5da7-43a1-8e5e-ecc49831f7c6 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:43.753198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853903e1-684d-4db8-96b0-4cf45bdb6003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:43.753891 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853903e1-684d-4db8-96b0-4cf45bdb6003 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.754173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853903e1-684d-4db8-96b0-4cf45bdb6003 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.754448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853903e1-684d-4db8-96b0-4cf45bdb6003 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.755189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853903e1-684d-4db8-96b0-4cf45bdb6003 None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:43.755493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853903e1-684d-4db8-96b0-4cf45bdb6003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:43.756882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853903e1-684d-4db8-96b0-4cf45bdb6003 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:43.760554 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3893c-aebb-407e-8ed2-9cc11b802c17 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:43.765402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 352/713] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:43.766251 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853903e1-684d-4db8-96b0-4cf45bdb6003 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:43.796435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce962a7-5dd7-44e5-9593-add672250865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:43.797138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce962a7-5dd7-44e5-9593-add672250865 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.797424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce962a7-5dd7-44e5-9593-add672250865 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.797733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce962a7-5dd7-44e5-9593-add672250865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.804681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce962a7-5dd7-44e5-9593-add672250865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:43.806177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce962a7-5dd7-44e5-9593-add672250865 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:43.819511 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-2ce962a7-5dd7-44e5-9593-add672250865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:43.820999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 362/714] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:43.822253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beeba4-6f46-431c-b950-4cc231d8cc98 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.822537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beeba4-6f46-431c-b950-4cc231d8cc98 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.822809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beeba4-6f46-431c-b950-4cc231d8cc98 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.829206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 363/715] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:43.829206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63beeba4-6f46-431c-b950-4cc231d8cc98 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:43.886719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853903e1-684d-4db8-96b0-4cf45bdb6003 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:43.924274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a204eac-21d9-4611-a56f-97f8d85b2f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:43.925198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a204eac-21d9-4611-a56f-97f8d85b2f31 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.925474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a204eac-21d9-4611-a56f-97f8d85b2f31 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.925793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a204eac-21d9-4611-a56f-97f8d85b2f31 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.926493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a204eac-21d9-4611-a56f-97f8d85b2f31 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:43.926799 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a204eac-21d9-4611-a56f-97f8d85b2f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:43.928184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a204eac-21d9-4611-a56f-97f8d85b2f31 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:43.932345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63beeba4-6f46-431c-b950-4cc231d8cc98 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:43.937200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 353/716] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Apr 6 12:41:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:43.938081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a204eac-21d9-4611-a56f-97f8d85b2f31 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:43.966387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4dac9-b514-4d6b-b588-ca4f2221b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:43.967186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4dac9-b514-4d6b-b588-ca4f2221b39b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.967482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4dac9-b514-4d6b-b588-ca4f2221b39b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:43.967758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4dac9-b514-4d6b-b588-ca4f2221b39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:43.977529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4dac9-b514-4d6b-b588-ca4f2221b39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:43.979010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4dac9-b514-4d6b-b588-ca4f2221b39b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:43.996718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-5ae4dac9-b514-4d6b-b588-ca4f2221b39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:43.998374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 364/717] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:43.999603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816dad2-fe36-46c3-8699-fd57374b3aba None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:43.999892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816dad2-fe36-46c3-8699-fd57374b3aba None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:44.000164 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816dad2-fe36-46c3-8699-fd57374b3aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:44.018014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-6816dad2-fe36-46c3-8699-fd57374b3aba None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:44.019198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6816dad2-fe36-46c3-8699-fd57374b3aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:44.041231 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a204eac-21d9-4611-a56f-97f8d85b2f31 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:44.075028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c83d3-5c40-41a0-ae4f-6f78d993530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:44.075791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c83d3-5c40-41a0-ae4f-6f78d993530c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:44.076074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c83d3-5c40-41a0-ae4f-6f78d993530c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:44.076361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c83d3-5c40-41a0-ae4f-6f78d993530c None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:44.077156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c83d3-5c40-41a0-ae4f-6f78d993530c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:44.077465 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c83d3-5c40-41a0-ae4f-6f78d993530c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:44.078957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c83d3-5c40-41a0-ae4f-6f78d993530c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:44.087079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 365/718] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:44.088156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816dad2-fe36-46c3-8699-fd57374b3aba None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:44.101246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 354/719] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:44.107090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c83d3-5c40-41a0-ae4f-6f78d993530c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:44.201301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816dad2-fe36-46c3-8699-fd57374b3aba None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:44.209480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c83d3-5c40-41a0-ae4f-6f78d993530c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:44.234523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cdd7f-df04-456e-b16d-5faaf3f9b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:44.235193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cdd7f-df04-456e-b16d-5faaf3f9b45d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:44.235479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cdd7f-df04-456e-b16d-5faaf3f9b45d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:44.235756 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cdd7f-df04-456e-b16d-5faaf3f9b45d None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:44.236468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cdd7f-df04-456e-b16d-5faaf3f9b45d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:44.236784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cdd7f-df04-456e-b16d-5faaf3f9b45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:44.238191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cdd7f-df04-456e-b16d-5faaf3f9b45d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:44.243665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 366/720] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Apr 6 12:41:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:44.244443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cdd7f-df04-456e-b16d-5faaf3f9b45d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:44.263893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50877ec-123a-43f7-84fa-8de28a232536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:44.265133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50877ec-123a-43f7-84fa-8de28a232536 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:44.265629 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50877ec-123a-43f7-84fa-8de28a232536 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:44.266536 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50877ec-123a-43f7-84fa-8de28a232536 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:44.267523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50877ec-123a-43f7-84fa-8de28a232536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:44.268024 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50877ec-123a-43f7-84fa-8de28a232536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:44.270258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50877ec-123a-43f7-84fa-8de28a232536 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:44.283290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 355/721] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:44.284270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50877ec-123a-43f7-84fa-8de28a232536 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:44.363749 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cdd7f-df04-456e-b16d-5faaf3f9b45d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:44.401758 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50877ec-123a-43f7-84fa-8de28a232536 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:44.405796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4394c-e45a-4666-97db-44c4bcb2c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:44.406877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4394c-e45a-4666-97db-44c4bcb2c3ce None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:44.407419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4394c-e45a-4666-97db-44c4bcb2c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:44.407946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4394c-e45a-4666-97db-44c4bcb2c3ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:44.409154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4394c-e45a-4666-97db-44c4bcb2c3ce None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=65b295446c7741ea96caf60ac955d82d) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:44.409784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4394c-e45a-4666-97db-44c4bcb2c3ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:44.411822 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4394c-e45a-4666-97db-44c4bcb2c3ce None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:44.426048 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 367/722] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:44 2022] GET /identity/v3/role_assignments?user.id=65b295446c7741ea96caf60ac955d82d&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=c158bb1781c44a03890992161076b84b => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:44.427338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4394c-e45a-4666-97db-44c4bcb2c3ce None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:44.447467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c522c-4074-45e8-839f-59f181b8438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:44.448851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c522c-4074-45e8-839f-59f181b8438d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:44.449210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c522c-4074-45e8-839f-59f181b8438d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:44.450440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c522c-4074-45e8-839f-59f181b8438d None admin] PATH_INFO: `/v3/services/network` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:44.451430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c522c-4074-45e8-839f-59f181b8438d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:44.453343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c522c-4074-45e8-839f-59f181b8438d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:44.471893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-b19c522c-4074-45e8-839f-59f181b8438d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 06 12:41:44.473517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 356/723] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:44 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:44.481369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c522c-4074-45e8-839f-59f181b8438d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:44.559395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4394c-e45a-4666-97db-44c4bcb2c3ce None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:44.590007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c522c-4074-45e8-839f-59f181b8438d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:44.607317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56eb41-c7d8-47df-b425-71c48516ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:44.608509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56eb41-c7d8-47df-b425-71c48516ad53 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:44.609030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56eb41-c7d8-47df-b425-71c48516ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:44.609501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56eb41-c7d8-47df-b425-71c48516ad53 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:44.626694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56eb41-c7d8-47df-b425-71c48516ad53 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:44.628208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56eb41-c7d8-47df-b425-71c48516ad53 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:44.634360 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7e339-fdcb-4a88-a2f0-3576a0306c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:44.635053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7e339-fdcb-4a88-a2f0-3576a0306c19 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:44.635339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7e339-fdcb-4a88-a2f0-3576a0306c19 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:44.635616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7e339-fdcb-4a88-a2f0-3576a0306c19 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:44.636349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7e339-fdcb-4a88-a2f0-3576a0306c19 None admin] RBAC: Adding query filter params (name=network) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:44.636661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7e339-fdcb-4a88-a2f0-3576a0306c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:44.638684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7e339-fdcb-4a88-a2f0-3576a0306c19 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:44.643931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 357/724] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:41:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:44.649612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7e339-fdcb-4a88-a2f0-3576a0306c19 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:44.659031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-0e56eb41-c7d8-47df-b425-71c48516ad53 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 12:41:44.660647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 368/725] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Apr 6 12:41:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:44.666838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56eb41-c7d8-47df-b425-71c48516ad53 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:44.763527 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7e339-fdcb-4a88-a2f0-3576a0306c19 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:44.777549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56eb41-c7d8-47df-b425-71c48516ad53 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:44.800361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431e11b-eef2-43bc-b027-4c3846a22d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:44.801033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e11b-eef2-43bc-b027-4c3846a22d0a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:44.801321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e11b-eef2-43bc-b027-4c3846a22d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:44.801618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431e11b-eef2-43bc-b027-4c3846a22d0a None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:44.802342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431e11b-eef2-43bc-b027-4c3846a22d0a None admin] RBAC: Adding query filter params (type=network) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:44.802663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431e11b-eef2-43bc-b027-4c3846a22d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:44.804040 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431e11b-eef2-43bc-b027-4c3846a22d0a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:44.811249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 358/726] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:41:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:44.821617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76ea3d-046d-42aa-9f65-d241b763a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:44.821617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76ea3d-046d-42aa-9f65-d241b763a088 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:44.821617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76ea3d-046d-42aa-9f65-d241b763a088 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:44.821617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76ea3d-046d-42aa-9f65-d241b763a088 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:44.822030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76ea3d-046d-42aa-9f65-d241b763a088 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:44.822030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76ea3d-046d-42aa-9f65-d241b763a088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:44.822368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76ea3d-046d-42aa-9f65-d241b763a088 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:44.843541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 369/727] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Apr 6 12:41:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:44.848601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431e11b-eef2-43bc-b027-4c3846a22d0a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:44.997748 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431e11b-eef2-43bc-b027-4c3846a22d0a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:45.042861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95101-7ec7-4586-884e-99778e4a1bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:45.044178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95101-7ec7-4586-884e-99778e4a1bc3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:45.044454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95101-7ec7-4586-884e-99778e4a1bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:45.044729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95101-7ec7-4586-884e-99778e4a1bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:45.157106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf95101-7ec7-4586-884e-99778e4a1bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:45.159723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf95101-7ec7-4586-884e-99778e4a1bc3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:45.317129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 359/728] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 06 12:41:45.322628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76ea3d-046d-42aa-9f65-d241b763a088 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:45.457173 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76ea3d-046d-42aa-9f65-d241b763a088 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:45.500934 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e307e-0cab-4bc0-b320-e0cc8bb32da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:45.502320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e307e-0cab-4bc0-b320-e0cc8bb32da3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:45.502811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e307e-0cab-4bc0-b320-e0cc8bb32da3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:45.503277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e307e-0cab-4bc0-b320-e0cc8bb32da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:45.515983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e307e-0cab-4bc0-b320-e0cc8bb32da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:45.517445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e307e-0cab-4bc0-b320-e0cc8bb32da3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:45.538270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-878e307e-0cab-4bc0-b320-e0cc8bb32da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:45.540010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 370/729] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:45.546442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95101-7ec7-4586-884e-99778e4a1bc3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:45.657873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95101-7ec7-4586-884e-99778e4a1bc3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:45.702312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da139b69-582b-4fec-bf4f-d06f6d7801ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:45.702990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da139b69-582b-4fec-bf4f-d06f6d7801ba None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:45.703275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da139b69-582b-4fec-bf4f-d06f6d7801ba None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:45.703565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da139b69-582b-4fec-bf4f-d06f6d7801ba None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:45.704285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da139b69-582b-4fec-bf4f-d06f6d7801ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:45.704586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da139b69-582b-4fec-bf4f-d06f6d7801ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:45.706022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da139b69-582b-4fec-bf4f-d06f6d7801ba None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:45.718955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 360/730] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:45.724317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e307e-0cab-4bc0-b320-e0cc8bb32da3 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:45.867435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c9c0-5f4d-4082-89b5-1610bebbdd8d None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:45.867855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c9c0-5f4d-4082-89b5-1610bebbdd8d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:45.868269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c9c0-5f4d-4082-89b5-1610bebbdd8d None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:45.870743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 361/731] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:45.873562 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e307e-0cab-4bc0-b320-e0cc8bb32da3 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:45.876168 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d62d54-b902-45db-b575-b45827bee354 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:45.876666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d62d54-b902-45db-b575-b45827bee354 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:45.877136 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d62d54-b902-45db-b575-b45827bee354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:45.906067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-96d62d54-b902-45db-b575-b45827bee354 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:45.907293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-96d62d54-b902-45db-b575-b45827bee354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:45.941615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136c8d3-3967-4a73-9eaa-059224fcf5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:45.942425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136c8d3-3967-4a73-9eaa-059224fcf5da None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:45.942709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136c8d3-3967-4a73-9eaa-059224fcf5da None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:45.942984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136c8d3-3967-4a73-9eaa-059224fcf5da None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:45.959051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136c8d3-3967-4a73-9eaa-059224fcf5da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:45.960530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136c8d3-3967-4a73-9eaa-059224fcf5da None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:45.984515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-d136c8d3-3967-4a73-9eaa-059224fcf5da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:45.997769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 371/732] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:45.998720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136c8d3-3967-4a73-9eaa-059224fcf5da None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:46.032078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 362/733] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:46.057224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d62d54-b902-45db-b575-b45827bee354 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:46.161524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136c8d3-3967-4a73-9eaa-059224fcf5da None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:46.201299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d62d54-b902-45db-b575-b45827bee354 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:46.209236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfd03c-2516-4899-9c9a-e0fa7016035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:46.209943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfd03c-2516-4899-9c9a-e0fa7016035e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:46.210231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfd03c-2516-4899-9c9a-e0fa7016035e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:46.210510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfd03c-2516-4899-9c9a-e0fa7016035e None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:46.211314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfd03c-2516-4899-9c9a-e0fa7016035e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:46.211792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfd03c-2516-4899-9c9a-e0fa7016035e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:46.213227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfd03c-2516-4899-9c9a-e0fa7016035e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:46.236779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e9052-2d6c-445e-a600-c192ceca46b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:46.237827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e9052-2d6c-445e-a600-c192ceca46b9 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:46.238250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e9052-2d6c-445e-a600-c192ceca46b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:46.238679 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e9052-2d6c-445e-a600-c192ceca46b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:46.240373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 372/734] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:46.250304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfd03c-2516-4899-9c9a-e0fa7016035e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:46.255683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e9052-2d6c-445e-a600-c192ceca46b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:46.266585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-434e9052-2d6c-445e-a600-c192ceca46b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:41:46.269131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 363/735] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:46.282147 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e9052-2d6c-445e-a600-c192ceca46b9 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:46.374909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfd03c-2516-4899-9c9a-e0fa7016035e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:46.391009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e9052-2d6c-445e-a600-c192ceca46b9 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:46.426288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b8b4-518c-4bf2-85ae-a6db44c9ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:46.426965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b8b4-518c-4bf2-85ae-a6db44c9ca64 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:46.427253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b8b4-518c-4bf2-85ae-a6db44c9ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:46.427534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b8b4-518c-4bf2-85ae-a6db44c9ca64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:46.428377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111b8b4-518c-4bf2-85ae-a6db44c9ca64 None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=dc8964c44ba54772b29ca1e584be8c12) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:46.428700 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111b8b4-518c-4bf2-85ae-a6db44c9ca64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:46.430202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111b8b4-518c-4bf2-85ae-a6db44c9ca64 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:46.433703 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b34a-290d-4353-8fe4-63b45e3544a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:46.435164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b34a-290d-4353-8fe4-63b45e3544a7 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:46.435643 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b34a-290d-4353-8fe4-63b45e3544a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:46.436104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76b34a-290d-4353-8fe4-63b45e3544a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:46.436949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 373/736] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:46 2022] GET /identity/v3/role_assignments?user.id=dc8964c44ba54772b29ca1e584be8c12&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:46.437273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76b34a-290d-4353-8fe4-63b45e3544a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:46.437792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76b34a-290d-4353-8fe4-63b45e3544a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:46.444385 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76b34a-290d-4353-8fe4-63b45e3544a7 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:46.462941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 364/737] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:46.469161 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b8b4-518c-4bf2-85ae-a6db44c9ca64 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:46.593934 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b8b4-518c-4bf2-85ae-a6db44c9ca64 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:46.637897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987cc7b-b7c7-4a32-9c76-3228605e13b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:46.638717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987cc7b-b7c7-4a32-9c76-3228605e13b6 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:46.639002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987cc7b-b7c7-4a32-9c76-3228605e13b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:46.639277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d987cc7b-b7c7-4a32-9c76-3228605e13b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:46.655608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987cc7b-b7c7-4a32-9c76-3228605e13b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:46.657113 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d987cc7b-b7c7-4a32-9c76-3228605e13b6 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:46.675893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-d987cc7b-b7c7-4a32-9c76-3228605e13b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:46.677470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 374/738] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:46.683197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b34a-290d-4353-8fe4-63b45e3544a7 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:46.801381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76b34a-290d-4353-8fe4-63b45e3544a7 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:46.853015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb9785-7def-4c59-a7b9-a729562b6e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:46.853931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb9785-7def-4c59-a7b9-a729562b6e73 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:46.854354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb9785-7def-4c59-a7b9-a729562b6e73 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:46.854766 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb9785-7def-4c59-a7b9-a729562b6e73 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:46.856298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb9785-7def-4c59-a7b9-a729562b6e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:46.856757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb9785-7def-4c59-a7b9-a729562b6e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:46.858317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb9785-7def-4c59-a7b9-a729562b6e73 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:46.875122 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 365/739] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:46.882642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987cc7b-b7c7-4a32-9c76-3228605e13b6 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:47.045249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d987cc7b-b7c7-4a32-9c76-3228605e13b6 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:47.093894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739a623-ba68-48f5-9958-c29cf8bf5477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:47.094692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739a623-ba68-48f5-9958-c29cf8bf5477 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:47.094976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739a623-ba68-48f5-9958-c29cf8bf5477 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:47.095254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739a623-ba68-48f5-9958-c29cf8bf5477 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:47.107899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739a623-ba68-48f5-9958-c29cf8bf5477 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:47.109296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739a623-ba68-48f5-9958-c29cf8bf5477 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:47.126355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-0739a623-ba68-48f5-9958-c29cf8bf5477 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 12:41:47.127880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 375/740] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:47.133124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb9785-7def-4c59-a7b9-a729562b6e73 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:47.275776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb9785-7def-4c59-a7b9-a729562b6e73 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:47.312242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7dd0-dd5b-4c57-85e2-6785335266f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:47.312917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7dd0-dd5b-4c57-85e2-6785335266f7 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:47.313203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7dd0-dd5b-4c57-85e2-6785335266f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:47.313480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c7dd0-dd5b-4c57-85e2-6785335266f7 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:47.314351 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7dd0-dd5b-4c57-85e2-6785335266f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:47.314663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7dd0-dd5b-4c57-85e2-6785335266f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:47.316139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c7dd0-dd5b-4c57-85e2-6785335266f7 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:47.335144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 366/741] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Apr 6 12:41:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:47.343191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a7f6-c058-4f28-a0dc-d2455462ef8a None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:47.343487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a7f6-c058-4f28-a0dc-d2455462ef8a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:47.343773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a7f6-c058-4f28-a0dc-d2455462ef8a None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:47.345272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 376/742] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:47.346110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7dd0-dd5b-4c57-85e2-6785335266f7 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:47.350735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d56b2-834c-4ed6-879d-fe15c63bb68a None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:47.351027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d56b2-834c-4ed6-879d-fe15c63bb68a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:47.351305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d56b2-834c-4ed6-879d-fe15c63bb68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:47.380712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2d1d56b2-834c-4ed6-879d-fe15c63bb68a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:47.381859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2d1d56b2-834c-4ed6-879d-fe15c63bb68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:47.474702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 377/743] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 06 12:41:47.476714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56ae13-f398-4453-a2a2-e9634674dad1 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:47.477006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56ae13-f398-4453-a2a2-e9634674dad1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:47.477433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56ae13-f398-4453-a2a2-e9634674dad1 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:47.479622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 378/744] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:47.482247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c7dd0-dd5b-4c57-85e2-6785335266f7 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:47.486598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89335b36-ae95-4b25-8ecf-e8c6f83b99d1 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:47.486889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89335b36-ae95-4b25-8ecf-e8c6f83b99d1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:47.487172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89335b36-ae95-4b25-8ecf-e8c6f83b99d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:47.509114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-89335b36-ae95-4b25-8ecf-e8c6f83b99d1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:47.510952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-89335b36-ae95-4b25-8ecf-e8c6f83b99d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:47.520537 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1e974-8d96-45f4-a693-a9ec50040033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:47.521199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1e974-8d96-45f4-a693-a9ec50040033 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:47.521482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1e974-8d96-45f4-a693-a9ec50040033 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:47.521787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1e974-8d96-45f4-a693-a9ec50040033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:47.600553 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1e974-8d96-45f4-a693-a9ec50040033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:47.602085 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1e974-8d96-45f4-a693-a9ec50040033 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:47.606054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 379/745] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:47.606927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89335b36-ae95-4b25-8ecf-e8c6f83b99d1 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:47.714823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 367/746] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 06 12:41:47.715660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1e974-8d96-45f4-a693-a9ec50040033 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:47.723572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89335b36-ae95-4b25-8ecf-e8c6f83b99d1 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:47.758339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134eab1-0017-441a-8d32-62f1df14c21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:47.759021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134eab1-0017-441a-8d32-62f1df14c21d None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:47.759303 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134eab1-0017-441a-8d32-62f1df14c21d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:47.759577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134eab1-0017-441a-8d32-62f1df14c21d None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:47.760323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134eab1-0017-441a-8d32-62f1df14c21d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:47.762337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134eab1-0017-441a-8d32-62f1df14c21d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:47.787290 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 380/747] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:41:47 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:41:47.788329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134eab1-0017-441a-8d32-62f1df14c21d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:47.827123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1e974-8d96-45f4-a693-a9ec50040033 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:47.890476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35936c5-c593-4227-8f37-ba093f50f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:47.891298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35936c5-c593-4227-8f37-ba093f50f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:47.891576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35936c5-c593-4227-8f37-ba093f50f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:47.891844 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35936c5-c593-4227-8f37-ba093f50f5b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:47.904522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35936c5-c593-4227-8f37-ba093f50f5b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:47.911629 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-f35936c5-c593-4227-8f37-ba093f50f5b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:41:47.913068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 368/748] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:47.916150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134eab1-0017-441a-8d32-62f1df14c21d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:47.919795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35936c5-c593-4227-8f37-ba093f50f5b4 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:47.956871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133e7e7-5cb9-48e1-9cfb-76ab427be749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:47.957755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133e7e7-5cb9-48e1-9cfb-76ab427be749 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:47.958093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133e7e7-5cb9-48e1-9cfb-76ab427be749 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:47.958372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133e7e7-5cb9-48e1-9cfb-76ab427be749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:47.971988 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133e7e7-5cb9-48e1-9cfb-76ab427be749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:47.973443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133e7e7-5cb9-48e1-9cfb-76ab427be749 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:47.992468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-a133e7e7-5cb9-48e1-9cfb-76ab427be749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:47.994201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 381/749] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:48.003912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133e7e7-5cb9-48e1-9cfb-76ab427be749 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:48.030427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35936c5-c593-4227-8f37-ba093f50f5b4 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:48.064606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099780f9-7942-433f-8acc-0a9b17caa8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:48.065277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099780f9-7942-433f-8acc-0a9b17caa8b1 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.065553 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099780f9-7942-433f-8acc-0a9b17caa8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.065853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099780f9-7942-433f-8acc-0a9b17caa8b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.066596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099780f9-7942-433f-8acc-0a9b17caa8b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:48.066896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099780f9-7942-433f-8acc-0a9b17caa8b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:48.068297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099780f9-7942-433f-8acc-0a9b17caa8b1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:48.081690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 369/750] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:48.083893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099780f9-7942-433f-8acc-0a9b17caa8b1 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:48.122973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133e7e7-5cb9-48e1-9cfb-76ab427be749 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:48.159980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc76c8-b1f1-4ac2-a4aa-80ab886092e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:48.160655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc76c8-b1f1-4ac2-a4aa-80ab886092e0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.160940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc76c8-b1f1-4ac2-a4aa-80ab886092e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.161218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc76c8-b1f1-4ac2-a4aa-80ab886092e0 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.161981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc76c8-b1f1-4ac2-a4aa-80ab886092e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:48.162814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc76c8-b1f1-4ac2-a4aa-80ab886092e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:48.163726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc76c8-b1f1-4ac2-a4aa-80ab886092e0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:48.179157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 382/751] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:48.186597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc76c8-b1f1-4ac2-a4aa-80ab886092e0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:48.193273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099780f9-7942-433f-8acc-0a9b17caa8b1 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:48.235606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5c7b6-6b65-4b58-b8bf-01ffa9ee7bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:48.236908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c7b6-6b65-4b58-b8bf-01ffa9ee7bde None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.237852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c7b6-6b65-4b58-b8bf-01ffa9ee7bde None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.238337 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c7b6-6b65-4b58-b8bf-01ffa9ee7bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.252280 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5c7b6-6b65-4b58-b8bf-01ffa9ee7bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:48.254746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d5c7b6-6b65-4b58-b8bf-01ffa9ee7bde None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:48.274129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-75d5c7b6-6b65-4b58-b8bf-01ffa9ee7bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:48.280407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 370/752] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:48.282238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5c7b6-6b65-4b58-b8bf-01ffa9ee7bde None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:48.300175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc76c8-b1f1-4ac2-a4aa-80ab886092e0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:48.337887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891c9fc-2c26-4bab-b043-45f0339098b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:48.338854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891c9fc-2c26-4bab-b043-45f0339098b7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.339273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891c9fc-2c26-4bab-b043-45f0339098b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.339682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891c9fc-2c26-4bab-b043-45f0339098b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.346692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891c9fc-2c26-4bab-b043-45f0339098b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:48.348325 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891c9fc-2c26-4bab-b043-45f0339098b7 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:48.362437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-0891c9fc-2c26-4bab-b043-45f0339098b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:48.364216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 383/753] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:48.365798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d548307-2c2d-4adc-bebc-16e2c0a6a8cc None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.366264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d548307-2c2d-4adc-bebc-16e2c0a6a8cc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.366728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d548307-2c2d-4adc-bebc-16e2c0a6a8cc None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.368450 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 384/754] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:48.369460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d548307-2c2d-4adc-bebc-16e2c0a6a8cc None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:48.405017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5c7b6-6b65-4b58-b8bf-01ffa9ee7bde None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:48.446599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ade4b1-7761-4d23-bac7-7c5b83331f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:48.447262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ade4b1-7761-4d23-bac7-7c5b83331f0e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.447540 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ade4b1-7761-4d23-bac7-7c5b83331f0e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.447814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ade4b1-7761-4d23-bac7-7c5b83331f0e None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.448530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ade4b1-7761-4d23-bac7-7c5b83331f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:48.448832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ade4b1-7761-4d23-bac7-7c5b83331f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:48.450794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ade4b1-7761-4d23-bac7-7c5b83331f0e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:48.470608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 371/755] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:48.470608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83241c7b-30f8-4f2c-a3da-4827e419639b None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.470608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83241c7b-30f8-4f2c-a3da-4827e419639b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.470608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83241c7b-30f8-4f2c-a3da-4827e419639b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.484356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d548307-2c2d-4adc-bebc-16e2c0a6a8cc None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:48.489452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-83241c7b-30f8-4f2c-a3da-4827e419639b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:48.490676 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-83241c7b-30f8-4f2c-a3da-4827e419639b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:48.521635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b250b-ab20-49b1-92d5-62ba49d9f33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:48.522603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b250b-ab20-49b1-92d5-62ba49d9f33c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.523047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b250b-ab20-49b1-92d5-62ba49d9f33c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.523503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b250b-ab20-49b1-92d5-62ba49d9f33c None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.524446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b250b-ab20-49b1-92d5-62ba49d9f33c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:48.524891 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b250b-ab20-49b1-92d5-62ba49d9f33c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:48.526585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b250b-ab20-49b1-92d5-62ba49d9f33c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:48.539919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 385/756] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:48.541075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b250b-ab20-49b1-92d5-62ba49d9f33c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:48.573747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 372/757] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 06 12:41:48.574760 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83241c7b-30f8-4f2c-a3da-4827e419639b None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:48.641037 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b250b-ab20-49b1-92d5-62ba49d9f33c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:48.675349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8fcf8-c7ac-4ec8-b556-831fd66240d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:48.676411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8fcf8-c7ac-4ec8-b556-831fd66240d6 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.676889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8fcf8-c7ac-4ec8-b556-831fd66240d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.677328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8fcf8-c7ac-4ec8-b556-831fd66240d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.685257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8fcf8-c7ac-4ec8-b556-831fd66240d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:48.686941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8fcf8-c7ac-4ec8-b556-831fd66240d6 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:48.688502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83241c7b-30f8-4f2c-a3da-4827e419639b None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:48.700945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-10f8fcf8-c7ac-4ec8-b556-831fd66240d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 12:41:48.702410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 386/758] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Apr 6 12:41:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:48.703379 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8fcf8-c7ac-4ec8-b556-831fd66240d6 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:48.723214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b629e-23b5-45fa-b349-5d6352a234c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:48.723777 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b629e-23b5-45fa-b349-5d6352a234c1 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.724065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b629e-23b5-45fa-b349-5d6352a234c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.724342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b629e-23b5-45fa-b349-5d6352a234c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.725228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b629e-23b5-45fa-b349-5d6352a234c1 None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=0118661184dc4cb198f65e831fb1fe8f) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:48.725539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b629e-23b5-45fa-b349-5d6352a234c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:48.727361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b629e-23b5-45fa-b349-5d6352a234c1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:48.733328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 373/759] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:48 2022] GET /identity/v3/role_assignments?user.id=0118661184dc4cb198f65e831fb1fe8f&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=c158bb1781c44a03890992161076b84b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:48.734154 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b629e-23b5-45fa-b349-5d6352a234c1 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:48.812084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8fcf8-c7ac-4ec8-b556-831fd66240d6 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:48.840160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b629e-23b5-45fa-b349-5d6352a234c1 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:48.848971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ef090-7996-441a-8237-3621b50b7064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:48.849969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ef090-7996-441a-8237-3621b50b7064 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.850453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ef090-7996-441a-8237-3621b50b7064 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.850943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ef090-7996-441a-8237-3621b50b7064 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.851852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ef090-7996-441a-8237-3621b50b7064 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:48.853413 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ef090-7996-441a-8237-3621b50b7064 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:48.873819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 387/760] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:41:48 2022] POST /identity/v3/services => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:41:48.911230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c2f44-725b-46b0-8871-0065682aad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:48.912031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c2f44-725b-46b0-8871-0065682aad4e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:48.912317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c2f44-725b-46b0-8871-0065682aad4e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:48.912600 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c2f44-725b-46b0-8871-0065682aad4e None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:48.913547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c2f44-725b-46b0-8871-0065682aad4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:48.913880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c2f44-725b-46b0-8871-0065682aad4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:48.915566 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c2f44-725b-46b0-8871-0065682aad4e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:48.948124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 374/761] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Apr 6 12:41:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:48.953845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ef090-7996-441a-8237-3621b50b7064 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:49.093977 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ef090-7996-441a-8237-3621b50b7064 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:49.131748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e08d8-a0a6-49da-8be8-f6adbd2a17e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:49.132959 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e08d8-a0a6-49da-8be8-f6adbd2a17e9 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:49.133411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e08d8-a0a6-49da-8be8-f6adbd2a17e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:49.133878 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e08d8-a0a6-49da-8be8-f6adbd2a17e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:49.145189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e08d8-a0a6-49da-8be8-f6adbd2a17e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:49.146950 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e08d8-a0a6-49da-8be8-f6adbd2a17e9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:49.164558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-cb8e08d8-a0a6-49da-8be8-f6adbd2a17e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:49.166427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 388/762] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:49.172229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c2f44-725b-46b0-8871-0065682aad4e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:49.178261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f57895-0abf-4761-b2fa-baac184e8dd8 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:49.178985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f57895-0abf-4761-b2fa-baac184e8dd8 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:49.179458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f57895-0abf-4761-b2fa-baac184e8dd8 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:49.182260 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 389/763] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:49.189558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f43767-764f-4124-ba81-8fe70c04f2de None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:49.190151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f43767-764f-4124-ba81-8fe70c04f2de None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:49.190595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f43767-764f-4124-ba81-8fe70c04f2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:49.210138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d7f43767-764f-4124-ba81-8fe70c04f2de None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:49.211594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d7f43767-764f-4124-ba81-8fe70c04f2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:49.294436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c2f44-725b-46b0-8871-0065682aad4e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:49.301655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 390/764] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:41:49.323640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f43767-764f-4124-ba81-8fe70c04f2de None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:49.383043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b164ebe-d5dd-4d92-ab51-51ff385d33cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:49.383545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b164ebe-d5dd-4d92-ab51-51ff385d33cd None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:49.383830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b164ebe-d5dd-4d92-ab51-51ff385d33cd None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:49.384106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b164ebe-d5dd-4d92-ab51-51ff385d33cd None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:49.384835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b164ebe-d5dd-4d92-ab51-51ff385d33cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:49.385222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b164ebe-d5dd-4d92-ab51-51ff385d33cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:49.386558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b164ebe-d5dd-4d92-ab51-51ff385d33cd None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:49.410094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 375/765] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:49.415290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b164ebe-d5dd-4d92-ab51-51ff385d33cd None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:49.436627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f43767-764f-4124-ba81-8fe70c04f2de None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:49.476553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34d4fb-8343-4798-9b83-262106b6f7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:49.477727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34d4fb-8343-4798-9b83-262106b6f7d4 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:49.478204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34d4fb-8343-4798-9b83-262106b6f7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:49.478668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34d4fb-8343-4798-9b83-262106b6f7d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:49.490602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34d4fb-8343-4798-9b83-262106b6f7d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:49.499483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-ca34d4fb-8343-4798-9b83-262106b6f7d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:49.505247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 391/766] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:49.507740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34d4fb-8343-4798-9b83-262106b6f7d4 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:49.616745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34d4fb-8343-4798-9b83-262106b6f7d4 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:49.653663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72b1a5-4d83-4649-8477-9ffee5f16270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:49.654993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72b1a5-4d83-4649-8477-9ffee5f16270 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:49.655580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72b1a5-4d83-4649-8477-9ffee5f16270 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:49.656067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72b1a5-4d83-4649-8477-9ffee5f16270 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:49.657002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72b1a5-4d83-4649-8477-9ffee5f16270 None admin] RBAC: Adding query filter params (name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:49.657513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72b1a5-4d83-4649-8477-9ffee5f16270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:49.659424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72b1a5-4d83-4649-8477-9ffee5f16270 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:49.667698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b164ebe-d5dd-4d92-ab51-51ff385d33cd None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:49.673665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 392/767] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:49.678169 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72b1a5-4d83-4649-8477-9ffee5f16270 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:49.767012 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eceb692-5d54-4419-a33e-5b04c648d7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:49.767841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eceb692-5d54-4419-a33e-5b04c648d7ba None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:49.768121 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eceb692-5d54-4419-a33e-5b04c648d7ba None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:49.768391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eceb692-5d54-4419-a33e-5b04c648d7ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:49.783218 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eceb692-5d54-4419-a33e-5b04c648d7ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:49.784992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eceb692-5d54-4419-a33e-5b04c648d7ba None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:49.803768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72b1a5-4d83-4649-8477-9ffee5f16270 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:49.815134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-2eceb692-5d54-4419-a33e-5b04c648d7ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:49.817041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 376/768] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:49.822202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eceb692-5d54-4419-a33e-5b04c648d7ba None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:49.887420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118bcad-da50-4102-9eb2-9bf7fa9b6a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:49.888296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118bcad-da50-4102-9eb2-9bf7fa9b6a70 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:49.888497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118bcad-da50-4102-9eb2-9bf7fa9b6a70 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:49.888770 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118bcad-da50-4102-9eb2-9bf7fa9b6a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:49.915653 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118bcad-da50-4102-9eb2-9bf7fa9b6a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:49.917039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118bcad-da50-4102-9eb2-9bf7fa9b6a70 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:49.933463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eceb692-5d54-4419-a33e-5b04c648d7ba None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:49.949881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-0118bcad-da50-4102-9eb2-9bf7fa9b6a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:49.955533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 393/769] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:49.969111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118bcad-da50-4102-9eb2-9bf7fa9b6a70 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:49.976833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c4587-1e11-4f61-b94c-c6de6427d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:49.977911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c4587-1e11-4f61-b94c-c6de6427d81a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:49.978389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c4587-1e11-4f61-b94c-c6de6427d81a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:49.978870 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c4587-1e11-4f61-b94c-c6de6427d81a None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:49.979855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c4587-1e11-4f61-b94c-c6de6427d81a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:49.980418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c4587-1e11-4f61-b94c-c6de6427d81a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:49.982373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c4587-1e11-4f61-b94c-c6de6427d81a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:49.996601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 377/770] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:50.003717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c4587-1e11-4f61-b94c-c6de6427d81a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:50.090866 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118bcad-da50-4102-9eb2-9bf7fa9b6a70 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:50.111298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c4587-1e11-4f61-b94c-c6de6427d81a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:50.135721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640966e-2cef-46ee-9323-d6aef96a0c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:50.136397 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640966e-2cef-46ee-9323-d6aef96a0c6e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:50.137279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640966e-2cef-46ee-9323-d6aef96a0c6e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:50.137556 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640966e-2cef-46ee-9323-d6aef96a0c6e None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:50.138308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640966e-2cef-46ee-9323-d6aef96a0c6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:50.138618 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640966e-2cef-46ee-9323-d6aef96a0c6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:50.139998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640966e-2cef-46ee-9323-d6aef96a0c6e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:50.147150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a160d-d53c-4622-878a-50023967adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:50.148301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a160d-d53c-4622-878a-50023967adc9 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:50.148798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a160d-d53c-4622-878a-50023967adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:50.149267 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a160d-d53c-4622-878a-50023967adc9 None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/65b295446c7741ea96caf60ac955d82d/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:50.151467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a160d-d53c-4622-878a-50023967adc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=65b295446c7741ea96caf60ac955d82d, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:50.153352 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a160d-d53c-4622-878a-50023967adc9 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:50.166269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 394/771] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:50.170761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640966e-2cef-46ee-9323-d6aef96a0c6e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:50.179977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 378/772] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:41:50 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/65b295446c7741ea96caf60ac955d82d/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:50.298865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640966e-2cef-46ee-9323-d6aef96a0c6e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:50.349278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dece81-175a-41e2-a2cf-05d6f6e53d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:50.350440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dece81-175a-41e2-a2cf-05d6f6e53d6a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:50.350921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dece81-175a-41e2-a2cf-05d6f6e53d6a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:50.351428 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dece81-175a-41e2-a2cf-05d6f6e53d6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:50.365196 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dece81-175a-41e2-a2cf-05d6f6e53d6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:50.367067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dece81-175a-41e2-a2cf-05d6f6e53d6a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:50.386347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-65dece81-175a-41e2-a2cf-05d6f6e53d6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 12:41:50.388355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 395/773] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Apr 6 12:41:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:50.394318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a160d-d53c-4622-878a-50023967adc9 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:50.527203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a160d-d53c-4622-878a-50023967adc9 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:50.565979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06cb2a-af9a-4fe9-bbae-0d44d7d07078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:50.566653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06cb2a-af9a-4fe9-bbae-0d44d7d07078 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:50.566996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06cb2a-af9a-4fe9-bbae-0d44d7d07078 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:50.567267 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06cb2a-af9a-4fe9-bbae-0d44d7d07078 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:50.568105 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06cb2a-af9a-4fe9-bbae-0d44d7d07078 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:50.568409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06cb2a-af9a-4fe9-bbae-0d44d7d07078 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:50.569895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06cb2a-af9a-4fe9-bbae-0d44d7d07078 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:50.588226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 379/774] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Apr 6 12:41:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:50.593503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dece81-175a-41e2-a2cf-05d6f6e53d6a None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:50.721424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dece81-175a-41e2-a2cf-05d6f6e53d6a None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:50.766546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9d22f-5f4e-4919-ad01-ff64bdbc9b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:50.767663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d22f-5f4e-4919-ad01-ff64bdbc9b6f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:50.768117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d22f-5f4e-4919-ad01-ff64bdbc9b6f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:50.768560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d22f-5f4e-4919-ad01-ff64bdbc9b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:50.782892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9d22f-5f4e-4919-ad01-ff64bdbc9b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:50.784616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9d22f-5f4e-4919-ad01-ff64bdbc9b6f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:50.805047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-b6e9d22f-5f4e-4919-ad01-ff64bdbc9b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:50.806964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 396/775] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:50.812418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06cb2a-af9a-4fe9-bbae-0d44d7d07078 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:50.901453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9428124-ee50-4379-9b29-802d62269178 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:50.901750 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9428124-ee50-4379-9b29-802d62269178 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:50.902026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9428124-ee50-4379-9b29-802d62269178 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:50.903545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 397/776] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:41:50.908706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd47a6-74d4-4026-994f-04074f262ba8 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:50.908997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd47a6-74d4-4026-994f-04074f262ba8 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:50.909275 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd47a6-74d4-4026-994f-04074f262ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:50.929139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06cb2a-af9a-4fe9-bbae-0d44d7d07078 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:50.954568 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-39bd47a6-74d4-4026-994f-04074f262ba8 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:50.955766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-39bd47a6-74d4-4026-994f-04074f262ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:50.962625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38771e62-2bc9-4951-aced-fd7375664058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:50.963488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771e62-2bc9-4951-aced-fd7375664058 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:50.963971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771e62-2bc9-4951-aced-fd7375664058 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:50.964414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38771e62-2bc9-4951-aced-fd7375664058 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:50.965887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38771e62-2bc9-4951-aced-fd7375664058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:50.966366 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38771e62-2bc9-4951-aced-fd7375664058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:50.967942 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38771e62-2bc9-4951-aced-fd7375664058 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:50.979464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 380/777] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:50.987310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38771e62-2bc9-4951-aced-fd7375664058 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:51.061495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 398/778] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:41:51.132593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd47a6-74d4-4026-994f-04074f262ba8 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:51.165938 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38771e62-2bc9-4951-aced-fd7375664058 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:51.231846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989beb5-49b6-46b9-af51-e54cc571caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:51.232656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989beb5-49b6-46b9-af51-e54cc571caaa None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:51.232941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989beb5-49b6-46b9-af51-e54cc571caaa None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:51.233219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989beb5-49b6-46b9-af51-e54cc571caaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:51.249101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989beb5-49b6-46b9-af51-e54cc571caaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:51.250620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989beb5-49b6-46b9-af51-e54cc571caaa None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:51.274707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-5989beb5-49b6-46b9-af51-e54cc571caaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:51.275949 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 381/779] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:51.283534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989beb5-49b6-46b9-af51-e54cc571caaa None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:51.307203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd47a6-74d4-4026-994f-04074f262ba8 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:51.349916 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfcd75-b9e5-4243-b75e-508ba8315d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:51.350744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfcd75-b9e5-4243-b75e-508ba8315d70 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:51.351270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfcd75-b9e5-4243-b75e-508ba8315d70 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:51.351606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfcd75-b9e5-4243-b75e-508ba8315d70 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:51.352792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfcd75-b9e5-4243-b75e-508ba8315d70 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:51.354264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfcd75-b9e5-4243-b75e-508ba8315d70 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:51.368181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-3bcfcd75-b9e5-4243-b75e-508ba8315d70 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 06 12:41:51.369770 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 399/780] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Apr 6 12:41:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:51.376035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfcd75-b9e5-4243-b75e-508ba8315d70 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:51.468851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989beb5-49b6-46b9-af51-e54cc571caaa None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:51.510625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d50a14-46ad-4ab4-b1d8-856474fca75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:51.511303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d50a14-46ad-4ab4-b1d8-856474fca75b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:51.512117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d50a14-46ad-4ab4-b1d8-856474fca75b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:51.512397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d50a14-46ad-4ab4-b1d8-856474fca75b None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:51.513358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d50a14-46ad-4ab4-b1d8-856474fca75b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:51.513773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d50a14-46ad-4ab4-b1d8-856474fca75b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:51.515248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d50a14-46ad-4ab4-b1d8-856474fca75b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:51.536787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 382/781] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:51.546033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d50a14-46ad-4ab4-b1d8-856474fca75b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:51.573233 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfcd75-b9e5-4243-b75e-508ba8315d70 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:51.641027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9128e-8fd7-46e5-95f5-a6b85b71131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:51.642482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9128e-8fd7-46e5-95f5-a6b85b71131d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:51.642962 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9128e-8fd7-46e5-95f5-a6b85b71131d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:51.643428 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9128e-8fd7-46e5-95f5-a6b85b71131d None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:51.644353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9128e-8fd7-46e5-95f5-a6b85b71131d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:51.644872 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9128e-8fd7-46e5-95f5-a6b85b71131d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:51.646455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9128e-8fd7-46e5-95f5-a6b85b71131d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:51.660084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 400/782] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Apr 6 12:41:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:51.665632 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9128e-8fd7-46e5-95f5-a6b85b71131d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:51.675033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d50a14-46ad-4ab4-b1d8-856474fca75b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:51.722879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5da9-3a13-45b5-86d7-6499a4c80266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:51.723780 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5da9-3a13-45b5-86d7-6499a4c80266 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:51.724065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5da9-3a13-45b5-86d7-6499a4c80266 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:51.724346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5da9-3a13-45b5-86d7-6499a4c80266 None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/dc8964c44ba54772b29ca1e584be8c12/roles/6f21bc5228c14338acc0d1711e7a1742` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:51.754962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf5da9-3a13-45b5-86d7-6499a4c80266 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=dc8964c44ba54772b29ca1e584be8c12, role_id=6f21bc5228c14338acc0d1711e7a1742)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:51.756466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf5da9-3a13-45b5-86d7-6499a4c80266 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:51.771793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9128e-8fd7-46e5-95f5-a6b85b71131d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:51.787795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 383/783] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:41:51 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/dc8964c44ba54772b29ca1e584be8c12/roles/6f21bc5228c14338acc0d1711e7a1742 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:51.809000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260132b-c853-4aad-9e9d-048460ea7ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:51.810089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260132b-c853-4aad-9e9d-048460ea7ac7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:51.810372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260132b-c853-4aad-9e9d-048460ea7ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:51.810641 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260132b-c853-4aad-9e9d-048460ea7ac7 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:51.810891 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243824d-31dd-4925-80a6-5d56e00574a1 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:51.811183 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243824d-31dd-4925-80a6-5d56e00574a1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:51.811348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260132b-c853-4aad-9e9d-048460ea7ac7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:51.811500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243824d-31dd-4925-80a6-5d56e00574a1 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:51.811645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260132b-c853-4aad-9e9d-048460ea7ac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:51.813056 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260132b-c853-4aad-9e9d-048460ea7ac7 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:51.813745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 384/784] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:51.818891 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 401/785] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Apr 6 12:41:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:51.825798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243824d-31dd-4925-80a6-5d56e00574a1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:51.827552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9396ee-8814-4dac-8863-75661d4471e5 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:51.828134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9396ee-8814-4dac-8863-75661d4471e5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:51.828637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9396ee-8814-4dac-8863-75661d4471e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:51.849212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-4e9396ee-8814-4dac-8863-75661d4471e5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:51.850686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4e9396ee-8814-4dac-8863-75661d4471e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:51.923919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 402/786] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:41:51.925894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0beb4a-24cc-45f6-8f03-e0906f2bbd92 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:51.926306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0beb4a-24cc-45f6-8f03-e0906f2bbd92 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:51.926741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0beb4a-24cc-45f6-8f03-e0906f2bbd92 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:51.932483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 403/787] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:51.935202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df777af0-2c7d-4bac-ba4f-02bd17494edf None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:51.935670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df777af0-2c7d-4bac-ba4f-02bd17494edf None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:51.936092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df777af0-2c7d-4bac-ba4f-02bd17494edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:51.961984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-df777af0-2c7d-4bac-ba4f-02bd17494edf None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:51.964054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-df777af0-2c7d-4bac-ba4f-02bd17494edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:51.971648 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243824d-31dd-4925-80a6-5d56e00574a1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:52.008431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de474f70-f3e2-42ed-82ed-984c7c02bbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:52.009013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474f70-f3e2-42ed-82ed-984c7c02bbdc None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:52.009368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474f70-f3e2-42ed-82ed-984c7c02bbdc None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:52.009765 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474f70-f3e2-42ed-82ed-984c7c02bbdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:52.010917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de474f70-f3e2-42ed-82ed-984c7c02bbdc None admin] RBAC: Adding query filter params (interface=public, service_id=995ad35d000542f6923f2419a25c5c66, region_id=RegionOne) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:52.011304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de474f70-f3e2-42ed-82ed-984c7c02bbdc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:52.013392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de474f70-f3e2-42ed-82ed-984c7c02bbdc None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:52.026510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 385/788] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Apr 6 12:41:51 2022] GET /identity/v3/endpoints?service_id=995ad35d000542f6923f2419a25c5c66&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:52.028398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de474f70-f3e2-42ed-82ed-984c7c02bbdc None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:52.057583 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 404/789] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:41:52.059156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df777af0-2c7d-4bac-ba4f-02bd17494edf None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:52.144855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de474f70-f3e2-42ed-82ed-984c7c02bbdc None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:52.180270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7723e09-b3d6-4646-bcff-9cde7612dd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:52.180984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723e09-b3d6-4646-bcff-9cde7612dd01 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:52.181182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df777af0-2c7d-4bac-ba4f-02bd17494edf None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:52.181285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723e09-b3d6-4646-bcff-9cde7612dd01 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:52.181519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7723e09-b3d6-4646-bcff-9cde7612dd01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:52.191997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7723e09-b3d6-4646-bcff-9cde7612dd01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:52.198906 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-a7723e09-b3d6-4646-bcff-9cde7612dd01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:41:52.200883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 386/790] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:52.201440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7723e09-b3d6-4646-bcff-9cde7612dd01 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:52.216747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0f224-1e73-463f-944e-2c0999334576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:52.217415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0f224-1e73-463f-944e-2c0999334576 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:52.217731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0f224-1e73-463f-944e-2c0999334576 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:52.218008 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0f224-1e73-463f-944e-2c0999334576 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:52.218697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0f224-1e73-463f-944e-2c0999334576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:52.220073 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0f224-1e73-463f-944e-2c0999334576 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:52.225265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 405/791] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Apr 6 12:41:52 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:52.226122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0f224-1e73-463f-944e-2c0999334576 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:52.303277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7723e09-b3d6-4646-bcff-9cde7612dd01 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:52.332435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0f224-1e73-463f-944e-2c0999334576 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:52.350571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317682aa-7b28-4e5c-86a3-0e399c9e80ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:52.351843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317682aa-7b28-4e5c-86a3-0e399c9e80ba None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:52.352128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317682aa-7b28-4e5c-86a3-0e399c9e80ba None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:52.352405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317682aa-7b28-4e5c-86a3-0e399c9e80ba None admin] PATH_INFO: `/v3/services/network` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:52.353068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317682aa-7b28-4e5c-86a3-0e399c9e80ba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:52.354958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317682aa-7b28-4e5c-86a3-0e399c9e80ba None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:52.368715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-317682aa-7b28-4e5c-86a3-0e399c9e80ba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 06 12:41:52.370398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 387/792] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:52 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:52.376912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317682aa-7b28-4e5c-86a3-0e399c9e80ba None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:52.384469 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134068f-e600-4430-954e-3b8f2b0f7cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:52.385246 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134068f-e600-4430-954e-3b8f2b0f7cff None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:52.385536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134068f-e600-4430-954e-3b8f2b0f7cff None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:52.385842 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134068f-e600-4430-954e-3b8f2b0f7cff None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:52.387610 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134068f-e600-4430-954e-3b8f2b0f7cff None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:52.387927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134068f-e600-4430-954e-3b8f2b0f7cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:52.391151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134068f-e600-4430-954e-3b8f2b0f7cff None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:52.407529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 406/793] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:52.419279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134068f-e600-4430-954e-3b8f2b0f7cff None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:52.551459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317682aa-7b28-4e5c-86a3-0e399c9e80ba None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:52.569236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134068f-e600-4430-954e-3b8f2b0f7cff None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:52.595653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6bdc4-ab3c-4e8b-8c6b-eae0c840c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:52.596680 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6bdc4-ab3c-4e8b-8c6b-eae0c840c75f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:52.596968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6bdc4-ab3c-4e8b-8c6b-eae0c840c75f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:52.597510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6bdc4-ab3c-4e8b-8c6b-eae0c840c75f None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:52.598254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6bdc4-ab3c-4e8b-8c6b-eae0c840c75f None admin] RBAC: Adding query filter params (name=network) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:52.598718 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6bdc4-ab3c-4e8b-8c6b-eae0c840c75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:52.600719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6bdc4-ab3c-4e8b-8c6b-eae0c840c75f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:52.607263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 388/794] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:41:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:52.608755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187bb35-285f-42b1-8dd4-441ca7204cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:52.609596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187bb35-285f-42b1-8dd4-441ca7204cfa None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:52.609881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187bb35-285f-42b1-8dd4-441ca7204cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:52.610159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187bb35-285f-42b1-8dd4-441ca7204cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:52.614630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6bdc4-ab3c-4e8b-8c6b-eae0c840c75f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:52.635616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187bb35-285f-42b1-8dd4-441ca7204cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:52.638057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187bb35-285f-42b1-8dd4-441ca7204cfa None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:52.655144 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-8187bb35-285f-42b1-8dd4-441ca7204cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:52.656660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 407/795] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:52.662168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187bb35-285f-42b1-8dd4-441ca7204cfa None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:52.751768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6bdc4-ab3c-4e8b-8c6b-eae0c840c75f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:52.794043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74dce1-f147-4bdc-9170-ffd1f9a82494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:52.794716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74dce1-f147-4bdc-9170-ffd1f9a82494 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:52.794997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74dce1-f147-4bdc-9170-ffd1f9a82494 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:52.795272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74dce1-f147-4bdc-9170-ffd1f9a82494 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:52.795981 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74dce1-f147-4bdc-9170-ffd1f9a82494 None admin] RBAC: Adding query filter params (type=network) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:52.796287 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74dce1-f147-4bdc-9170-ffd1f9a82494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:52.797703 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74dce1-f147-4bdc-9170-ffd1f9a82494 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:52.810186 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 389/796] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:41:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:52.818578 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74dce1-f147-4bdc-9170-ffd1f9a82494 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:52.822614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187bb35-285f-42b1-8dd4-441ca7204cfa None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:52.857912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2dac1-b816-4875-b44e-d9c27b6fad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:52.858624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2dac1-b816-4875-b44e-d9c27b6fad38 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:52.858911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2dac1-b816-4875-b44e-d9c27b6fad38 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:52.859188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2dac1-b816-4875-b44e-d9c27b6fad38 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:52.859910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2dac1-b816-4875-b44e-d9c27b6fad38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:52.860220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2dac1-b816-4875-b44e-d9c27b6fad38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:52.861613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c2dac1-b816-4875-b44e-d9c27b6fad38 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:52.874407 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 408/797] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:52.879763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2dac1-b816-4875-b44e-d9c27b6fad38 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:52.979869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c2dac1-b816-4875-b44e-d9c27b6fad38 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:53.013750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74dce1-f147-4bdc-9170-ffd1f9a82494 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:53.014650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e6b50-616b-430a-8712-29d98837cdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:53.015451 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e6b50-616b-430a-8712-29d98837cdb1 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.015736 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e6b50-616b-430a-8712-29d98837cdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.016013 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e6b50-616b-430a-8712-29d98837cdb1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.023552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e6b50-616b-430a-8712-29d98837cdb1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:53.025068 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e6b50-616b-430a-8712-29d98837cdb1 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:53.040409 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-ef6e6b50-616b-430a-8712-29d98837cdb1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 12:41:53.041947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 409/798] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:53.048827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e6b50-616b-430a-8712-29d98837cdb1 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:53.099779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340c0a-ff97-410a-a4f1-ebd53b7c22e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:53.100370 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340c0a-ff97-410a-a4f1-ebd53b7c22e8 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.100656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340c0a-ff97-410a-a4f1-ebd53b7c22e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.100935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340c0a-ff97-410a-a4f1-ebd53b7c22e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.101763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35340c0a-ff97-410a-a4f1-ebd53b7c22e8 None admin] RBAC: Adding query filter params (interface=public, service_id=4e161faa1a5a44118bb23cf6a990bae9, region_id=RegionOne) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:53.102082 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35340c0a-ff97-410a-a4f1-ebd53b7c22e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:53.103505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35340c0a-ff97-410a-a4f1-ebd53b7c22e8 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:53.124023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 390/799] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Apr 6 12:41:52 2022] GET /identity/v3/endpoints?service_id=4e161faa1a5a44118bb23cf6a990bae9&interface=public®ion_id=RegionOne => generated 194 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:53.129487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340c0a-ff97-410a-a4f1-ebd53b7c22e8 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:53.151027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e6b50-616b-430a-8712-29d98837cdb1 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:53.189033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fdf54-c5b9-4d5e-92ff-c7e2d7bc9970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:53.189737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fdf54-c5b9-4d5e-92ff-c7e2d7bc9970 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.190023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fdf54-c5b9-4d5e-92ff-c7e2d7bc9970 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.190297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fdf54-c5b9-4d5e-92ff-c7e2d7bc9970 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.191136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fdf54-c5b9-4d5e-92ff-c7e2d7bc9970 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:53.191445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fdf54-c5b9-4d5e-92ff-c7e2d7bc9970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:53.192876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fdf54-c5b9-4d5e-92ff-c7e2d7bc9970 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:53.210655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 410/800] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Apr 6 12:41:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:53.211962 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2efd4b-ed12-4169-bbc3-cd34b0cd8cec None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.212246 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2efd4b-ed12-4169-bbc3-cd34b0cd8cec None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.212521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2efd4b-ed12-4169-bbc3-cd34b0cd8cec None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.218925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 411/801] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:53.219735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2efd4b-ed12-4169-bbc3-cd34b0cd8cec None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:53.268179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340c0a-ff97-410a-a4f1-ebd53b7c22e8 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:53.302826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133424c8-b8d8-4ef3-a871-2fb09cfe229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:53.303491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133424c8-b8d8-4ef3-a871-2fb09cfe229b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.303775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133424c8-b8d8-4ef3-a871-2fb09cfe229b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.304113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133424c8-b8d8-4ef3-a871-2fb09cfe229b None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.304801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133424c8-b8d8-4ef3-a871-2fb09cfe229b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:53.306853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133424c8-b8d8-4ef3-a871-2fb09cfe229b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:53.313775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 391/802] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Apr 6 12:41:53 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:53.315080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e6d30-3052-42cd-ae3a-73b99b9f77a1 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.315368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e6d30-3052-42cd-ae3a-73b99b9f77a1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.315644 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e6d30-3052-42cd-ae3a-73b99b9f77a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.341594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-526e6d30-3052-42cd-ae3a-73b99b9f77a1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:53.341594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-526e6d30-3052-42cd-ae3a-73b99b9f77a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:53.345935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2efd4b-ed12-4169-bbc3-cd34b0cd8cec None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:53.397071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c75a8d-0855-452a-8f2b-3fa92afaf8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:53.397845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c75a8d-0855-452a-8f2b-3fa92afaf8e0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.398128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c75a8d-0855-452a-8f2b-3fa92afaf8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.398402 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c75a8d-0855-452a-8f2b-3fa92afaf8e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.423234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c75a8d-0855-452a-8f2b-3fa92afaf8e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:53.424981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c75a8d-0855-452a-8f2b-3fa92afaf8e0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:53.464335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-84c75a8d-0855-452a-8f2b-3fa92afaf8e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:53.466665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 412/803] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:53.474250 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c75a8d-0855-452a-8f2b-3fa92afaf8e0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:53.480863 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 392/804] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:41:53.526570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e6d30-3052-42cd-ae3a-73b99b9f77a1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:53.601001 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c75a8d-0855-452a-8f2b-3fa92afaf8e0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:53.634526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e6d30-3052-42cd-ae3a-73b99b9f77a1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:53.639931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a652e6c-3928-4f3e-bf61-fee9a2fd98be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:53.640604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a652e6c-3928-4f3e-bf61-fee9a2fd98be None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.640880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a652e6c-3928-4f3e-bf61-fee9a2fd98be None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.641156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a652e6c-3928-4f3e-bf61-fee9a2fd98be None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.641920 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a652e6c-3928-4f3e-bf61-fee9a2fd98be None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:53.642221 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a652e6c-3928-4f3e-bf61-fee9a2fd98be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:53.643616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a652e6c-3928-4f3e-bf61-fee9a2fd98be None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:53.656112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 413/805] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:53.666592 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a652e6c-3928-4f3e-bf61-fee9a2fd98be None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:53.687792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0684f-d3a3-4be5-b925-745a5f0ece44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:53.688601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0684f-d3a3-4be5-b925-745a5f0ece44 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.688884 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0684f-d3a3-4be5-b925-745a5f0ece44 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.689159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0684f-d3a3-4be5-b925-745a5f0ece44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.710605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0684f-d3a3-4be5-b925-745a5f0ece44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:53.725905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-98f0684f-d3a3-4be5-b925-745a5f0ece44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:41:53.727549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 393/806] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:53.747138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0684f-d3a3-4be5-b925-745a5f0ece44 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:53.774431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a652e6c-3928-4f3e-bf61-fee9a2fd98be None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:53.811003 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc438-aa99-42c2-b184-22041208b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:53.811791 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc438-aa99-42c2-b184-22041208b3a9 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.812068 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc438-aa99-42c2-b184-22041208b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.812335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dc438-aa99-42c2-b184-22041208b3a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.827945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dc438-aa99-42c2-b184-22041208b3a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:53.829489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dc438-aa99-42c2-b184-22041208b3a9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:53.857063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-048dc438-aa99-42c2-b184-22041208b3a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:53.858333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 414/807] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:53.865502 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc438-aa99-42c2-b184-22041208b3a9 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:53.951044 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0684f-d3a3-4be5-b925-745a5f0ece44 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:53.989872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb9949-ad8f-4f65-a5f9-9b587537c17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:53.990928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb9949-ad8f-4f65-a5f9-9b587537c17b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:53.991424 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb9949-ad8f-4f65-a5f9-9b587537c17b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:53.991899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb9949-ad8f-4f65-a5f9-9b587537c17b None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:53.992836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb9949-ad8f-4f65-a5f9-9b587537c17b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:53.993341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb9949-ad8f-4f65-a5f9-9b587537c17b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:53.994949 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb9949-ad8f-4f65-a5f9-9b587537c17b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:54.004316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 394/808] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:54.010603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb9949-ad8f-4f65-a5f9-9b587537c17b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:54.052027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dc438-aa99-42c2-b184-22041208b3a9 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:54.122181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a925dd5-e014-4120-9780-4d22a9d15314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:54.123269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a925dd5-e014-4120-9780-4d22a9d15314 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:54.123750 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a925dd5-e014-4120-9780-4d22a9d15314 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:54.124941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a925dd5-e014-4120-9780-4d22a9d15314 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:54.126243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a925dd5-e014-4120-9780-4d22a9d15314 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:54.127872 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a925dd5-e014-4120-9780-4d22a9d15314 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:54.134117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a925dd5-e014-4120-9780-4d22a9d15314 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:54.146962 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 415/809] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:54.158084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a925dd5-e014-4120-9780-4d22a9d15314 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:54.177180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb9949-ad8f-4f65-a5f9-9b587537c17b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:54.213544 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f9202-aeb5-4199-8112-0c4935717204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:54.214762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9202-aeb5-4199-8112-0c4935717204 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:54.215307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9202-aeb5-4199-8112-0c4935717204 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:54.215779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f9202-aeb5-4199-8112-0c4935717204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:54.227140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f9202-aeb5-4199-8112-0c4935717204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:54.229004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f9202-aeb5-4199-8112-0c4935717204 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:54.259658 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-822f9202-aeb5-4199-8112-0c4935717204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:54.264225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 395/810] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:54.269770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f9202-aeb5-4199-8112-0c4935717204 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:54.344596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a925dd5-e014-4120-9780-4d22a9d15314 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:54.383204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d612e4d-6eba-4744-bd31-4119f1e67388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:54.384478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d612e4d-6eba-4744-bd31-4119f1e67388 None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:54.385014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d612e4d-6eba-4744-bd31-4119f1e67388 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:54.385485 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d612e4d-6eba-4744-bd31-4119f1e67388 None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/0118661184dc4cb198f65e831fb1fe8f/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:54.388556 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d612e4d-6eba-4744-bd31-4119f1e67388 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=0118661184dc4cb198f65e831fb1fe8f, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:54.390776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d612e4d-6eba-4744-bd31-4119f1e67388 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:54.411563 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 416/811] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:41:54 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/0118661184dc4cb198f65e831fb1fe8f/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:41:54.452847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f9202-aeb5-4199-8112-0c4935717204 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:54.491091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cefa0-9dc8-468b-8e9c-926c5a698e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:54.492119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cefa0-9dc8-468b-8e9c-926c5a698e81 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:54.492617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cefa0-9dc8-468b-8e9c-926c5a698e81 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:54.493089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cefa0-9dc8-468b-8e9c-926c5a698e81 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:54.494071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cefa0-9dc8-468b-8e9c-926c5a698e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:54.494607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cefa0-9dc8-468b-8e9c-926c5a698e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:54.496933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cefa0-9dc8-468b-8e9c-926c5a698e81 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:54.510148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 396/812] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:54.518974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d612e4d-6eba-4744-bd31-4119f1e67388 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:54.524057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc356e94-e6c9-409c-879e-fa40b1fad1d7 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:54.524250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc356e94-e6c9-409c-879e-fa40b1fad1d7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:54.524453 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc356e94-e6c9-409c-879e-fa40b1fad1d7 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:54.527439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 397/813] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:41:54.532609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c040bc-9aae-40d1-adee-68af578571f6 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:54.532940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c040bc-9aae-40d1-adee-68af578571f6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:54.533155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c040bc-9aae-40d1-adee-68af578571f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:54.563932 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-58c040bc-9aae-40d1-adee-68af578571f6 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:54.565074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-58c040bc-9aae-40d1-adee-68af578571f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:54.641727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d612e4d-6eba-4744-bd31-4119f1e67388 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:54.682023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df194d-bde5-41e5-a803-70f8839ed53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:54.684291 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df194d-bde5-41e5-a803-70f8839ed53f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:54.684794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df194d-bde5-41e5-a803-70f8839ed53f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:54.685844 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df194d-bde5-41e5-a803-70f8839ed53f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:54.696649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df194d-bde5-41e5-a803-70f8839ed53f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:54.698520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df194d-bde5-41e5-a803-70f8839ed53f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:54.717387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-19df194d-bde5-41e5-a803-70f8839ed53f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 12:41:54.719615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 417/814] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Apr 6 12:41:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:54.725546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df194d-bde5-41e5-a803-70f8839ed53f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:54.730749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 398/815] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:41:54.755466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c040bc-9aae-40d1-adee-68af578571f6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:54.837350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df194d-bde5-41e5-a803-70f8839ed53f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:54.876121 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e349a3-36f0-4ed2-ab97-2c38c6ba8dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:54.877718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e349a3-36f0-4ed2-ab97-2c38c6ba8dcc None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:54.878209 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e349a3-36f0-4ed2-ab97-2c38c6ba8dcc None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:54.878704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e349a3-36f0-4ed2-ab97-2c38c6ba8dcc None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:54.879887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e349a3-36f0-4ed2-ab97-2c38c6ba8dcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:54.880396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e349a3-36f0-4ed2-ab97-2c38c6ba8dcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:54.882210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e349a3-36f0-4ed2-ab97-2c38c6ba8dcc None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:54.903030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 418/816] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Apr 6 12:41:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:54.909373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e349a3-36f0-4ed2-ab97-2c38c6ba8dcc None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:54.971399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c040bc-9aae-40d1-adee-68af578571f6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:55.037103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4642916-3d46-4818-9407-ddbdcb36b161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:55.038220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4642916-3d46-4818-9407-ddbdcb36b161 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.038667 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4642916-3d46-4818-9407-ddbdcb36b161 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.039084 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4642916-3d46-4818-9407-ddbdcb36b161 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.063078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4642916-3d46-4818-9407-ddbdcb36b161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:55.079913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-b4642916-3d46-4818-9407-ddbdcb36b161 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:41:55.081727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e349a3-36f0-4ed2-ab97-2c38c6ba8dcc None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:55.081893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 399/817] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:55.087219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4642916-3d46-4818-9407-ddbdcb36b161 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:55.120964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1095e-5dd6-4747-b9e2-21209b2e57a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:55.121698 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1095e-5dd6-4747-b9e2-21209b2e57a9 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.121984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1095e-5dd6-4747-b9e2-21209b2e57a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.122261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1095e-5dd6-4747-b9e2-21209b2e57a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.223906 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4642916-3d46-4818-9407-ddbdcb36b161 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:55.234027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1095e-5dd6-4747-b9e2-21209b2e57a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:55.235621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1095e-5dd6-4747-b9e2-21209b2e57a9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:55.266211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb976e-046e-4c74-a5fb-25ffa7d6f5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:55.267341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb976e-046e-4c74-a5fb-25ffa7d6f5c6 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.267697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb976e-046e-4c74-a5fb-25ffa7d6f5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.267909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb976e-046e-4c74-a5fb-25ffa7d6f5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.268935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb976e-046e-4c74-a5fb-25ffa7d6f5c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:55.269244 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb976e-046e-4c74-a5fb-25ffa7d6f5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:55.270947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb976e-046e-4c74-a5fb-25ffa7d6f5c6 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:55.281517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 400/818] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:41:55.282862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383003-4174-427f-a8ed-7b0f5cf8b5b2 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.283149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383003-4174-427f-a8ed-7b0f5cf8b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.283426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81383003-4174-427f-a8ed-7b0f5cf8b5b2 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.284903 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 401/819] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:55.289699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383003-4174-427f-a8ed-7b0f5cf8b5b2 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:55.363615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 419/820] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 06 12:41:55.365246 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef02e87-3397-4dfe-b431-40c9941d92a7 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.365780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef02e87-3397-4dfe-b431-40c9941d92a7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.366253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef02e87-3397-4dfe-b431-40c9941d92a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.386026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-fef02e87-3397-4dfe-b431-40c9941d92a7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:55.388378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-fef02e87-3397-4dfe-b431-40c9941d92a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:55.414754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81383003-4174-427f-a8ed-7b0f5cf8b5b2 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:55.450952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd8227-5961-4a4c-bbde-46d19cacfbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:55.451853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd8227-5961-4a4c-bbde-46d19cacfbbd None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.452034 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd8227-5961-4a4c-bbde-46d19cacfbbd None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.452286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd8227-5961-4a4c-bbde-46d19cacfbbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.459564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 420/821] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:41:55.465604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef02e87-3397-4dfe-b431-40c9941d92a7 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:55.465753 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd8227-5961-4a4c-bbde-46d19cacfbbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:55.466582 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddd8227-5961-4a4c-bbde-46d19cacfbbd None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:55.484377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-eddd8227-5961-4a4c-bbde-46d19cacfbbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:55.490234 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 402/822] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:55.491514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd8227-5961-4a4c-bbde-46d19cacfbbd None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:55.601265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef02e87-3397-4dfe-b431-40c9941d92a7 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:55.618404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd8227-5961-4a4c-bbde-46d19cacfbbd None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:55.643316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9516d6-cca0-4326-af7a-02b508634d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:55.645052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9516d6-cca0-4326-af7a-02b508634d37 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.645542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9516d6-cca0-4326-af7a-02b508634d37 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.646194 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9516d6-cca0-4326-af7a-02b508634d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.654508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1461b9-5436-4e9a-b153-a313af52aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:55.655341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1461b9-5436-4e9a-b153-a313af52aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.655669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1461b9-5436-4e9a-b153-a313af52aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.656347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1461b9-5436-4e9a-b153-a313af52aaf7 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.656694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1461b9-5436-4e9a-b153-a313af52aaf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:55.657002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1461b9-5436-4e9a-b153-a313af52aaf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:55.658562 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1461b9-5436-4e9a-b153-a313af52aaf7 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:55.661226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9516d6-cca0-4326-af7a-02b508634d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:55.662917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9516d6-cca0-4326-af7a-02b508634d37 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:55.676122 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 403/823] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:55.677029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1461b9-5436-4e9a-b153-a313af52aaf7 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:55.684004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-2c9516d6-cca0-4326-af7a-02b508634d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:55.686578 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 421/824] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:55.687588 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9516d6-cca0-4326-af7a-02b508634d37 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:55.799931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1461b9-5436-4e9a-b153-a313af52aaf7 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:55.801831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9516d6-cca0-4326-af7a-02b508634d37 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:55.835890 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b12e13-152c-48f9-a127-430629b43c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:55.837077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12e13-152c-48f9-a127-430629b43c00 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.837353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fcd9a-ebd6-4256-a111-5a81212d9df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:55.837833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12e13-152c-48f9-a127-430629b43c00 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.838205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fcd9a-ebd6-4256-a111-5a81212d9df7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.838484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fcd9a-ebd6-4256-a111-5a81212d9df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.838734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12e13-152c-48f9-a127-430629b43c00 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.838834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fcd9a-ebd6-4256-a111-5a81212d9df7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.839695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b12e13-152c-48f9-a127-430629b43c00 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:55.841293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b12e13-152c-48f9-a127-430629b43c00 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:55.846729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fcd9a-ebd6-4256-a111-5a81212d9df7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:55.848174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fcd9a-ebd6-4256-a111-5a81212d9df7 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:55.854042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-93b12e13-152c-48f9-a127-430629b43c00 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 06 12:41:55.860839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 404/825] 10.222.0.23 () {56 vars in 1129 bytes} [Wed Apr 6 12:41:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:55.861917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b12e13-152c-48f9-a127-430629b43c00 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:55.863992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-ed0fcd9a-ebd6-4256-a111-5a81212d9df7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 12:41:55.865202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 422/826] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Apr 6 12:41:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:55.870415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fcd9a-ebd6-4256-a111-5a81212d9df7 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:55.962272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b12e13-152c-48f9-a127-430629b43c00 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:55.969772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fcd9a-ebd6-4256-a111-5a81212d9df7 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:55.995127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0013c-03c6-47a1-abcc-8a4d5d3dbb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:55.995817 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0013c-03c6-47a1-abcc-8a4d5d3dbb55 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:55.996099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0013c-03c6-47a1-abcc-8a4d5d3dbb55 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:55.996470 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0013c-03c6-47a1-abcc-8a4d5d3dbb55 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:55.997196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0013c-03c6-47a1-abcc-8a4d5d3dbb55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:55.997504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0013c-03c6-47a1-abcc-8a4d5d3dbb55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:55.998925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0013c-03c6-47a1-abcc-8a4d5d3dbb55 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.002830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a51c-9b24-486b-9db7-356baaa9cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:56.003561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a51c-9b24-486b-9db7-356baaa9cb08 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.003561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a51c-9b24-486b-9db7-356baaa9cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.003723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a51c-9b24-486b-9db7-356baaa9cb08 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.003723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a51c-9b24-486b-9db7-356baaa9cb08 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:56.003723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a51c-9b24-486b-9db7-356baaa9cb08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:56.006196 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a51c-9b24-486b-9db7-356baaa9cb08 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.017687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 423/827] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Apr 6 12:41:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:56.017687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a51c-9b24-486b-9db7-356baaa9cb08 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:56.020006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 405/828] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:56.024985 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1cd93-ebb1-4e10-adad-189afa721757 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.026399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1cd93-ebb1-4e10-adad-189afa721757 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.026636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1cd93-ebb1-4e10-adad-189afa721757 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.030817 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 406/829] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:56.031306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1cd93-ebb1-4e10-adad-189afa721757 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:56.121010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a51c-9b24-486b-9db7-356baaa9cb08 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:56.130945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1cd93-ebb1-4e10-adad-189afa721757 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:56.154737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e746c6-3adc-4207-8881-69161adfd776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:56.155402 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e746c6-3adc-4207-8881-69161adfd776 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.155684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e746c6-3adc-4207-8881-69161adfd776 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.155966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e746c6-3adc-4207-8881-69161adfd776 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.156798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e746c6-3adc-4207-8881-69161adfd776 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:56.157105 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e746c6-3adc-4207-8881-69161adfd776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:56.158576 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e746c6-3adc-4207-8881-69161adfd776 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.169167 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddcc33-3707-41e4-bcc3-35878c816d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:56.169872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddcc33-3707-41e4-bcc3-35878c816d0b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.170152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddcc33-3707-41e4-bcc3-35878c816d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.170424 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddcc33-3707-41e4-bcc3-35878c816d0b None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.171128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddcc33-3707-41e4-bcc3-35878c816d0b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:56.171430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddcc33-3707-41e4-bcc3-35878c816d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:56.173321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddcc33-3707-41e4-bcc3-35878c816d0b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.175884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 424/830] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Apr 6 12:41:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:56.176711 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e746c6-3adc-4207-8881-69161adfd776 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:56.184687 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 407/831] 10.222.0.23 () {56 vars in 1124 bytes} [Wed Apr 6 12:41:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:56.186238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8ebf3-b7e2-4116-b5eb-6a6eb85cf1e3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.186772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8ebf3-b7e2-4116-b5eb-6a6eb85cf1e3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.187113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8ebf3-b7e2-4116-b5eb-6a6eb85cf1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.203381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b4a8ebf3-b7e2-4116-b5eb-6a6eb85cf1e3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:56.204571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b4a8ebf3-b7e2-4116-b5eb-6a6eb85cf1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:56.281601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 408/832] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:41:56.281601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8ebf3-b7e2-4116-b5eb-6a6eb85cf1e3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:56.291786 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e746c6-3adc-4207-8881-69161adfd776 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:56.334523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009647c-e126-4d0a-aadc-89155c12ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:56.335323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009647c-e126-4d0a-aadc-89155c12ca48 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.335605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009647c-e126-4d0a-aadc-89155c12ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.335876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009647c-e126-4d0a-aadc-89155c12ca48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.343449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009647c-e126-4d0a-aadc-89155c12ca48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:56.344978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009647c-e126-4d0a-aadc-89155c12ca48 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.360622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-f009647c-e126-4d0a-aadc-89155c12ca48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:56.361900 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 425/833] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:56.362643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009647c-e126-4d0a-aadc-89155c12ca48 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:56.378671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8ebf3-b7e2-4116-b5eb-6a6eb85cf1e3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:56.413381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec166d7-f31f-4203-8626-d861ceea0dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:56.414142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec166d7-f31f-4203-8626-d861ceea0dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.414504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec166d7-f31f-4203-8626-d861ceea0dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.414845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec166d7-f31f-4203-8626-d861ceea0dc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.463065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009647c-e126-4d0a-aadc-89155c12ca48 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:56.483209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec166d7-f31f-4203-8626-d861ceea0dc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:56.484695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec166d7-f31f-4203-8626-d861ceea0dc5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.496836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f3979-ad94-4623-bfa3-835954519639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:56.497491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f3979-ad94-4623-bfa3-835954519639 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.497801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f3979-ad94-4623-bfa3-835954519639 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.498082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f3979-ad94-4623-bfa3-835954519639 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.498823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f3979-ad94-4623-bfa3-835954519639 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:56.500185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f3979-ad94-4623-bfa3-835954519639 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.520432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 426/834] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Apr 6 12:41:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:41:56.521305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f3979-ad94-4623-bfa3-835954519639 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:56.602514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 409/835] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:41:56.603446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec166d7-f31f-4203-8626-d861ceea0dc5 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:56.657158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f3979-ad94-4623-bfa3-835954519639 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:56.697374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c06c05-5b36-49fe-9051-6e64e8ab7f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:56.699585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c06c05-5b36-49fe-9051-6e64e8ab7f1f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.700077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c06c05-5b36-49fe-9051-6e64e8ab7f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.700575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c06c05-5b36-49fe-9051-6e64e8ab7f1f None admin] PATH_INFO: `/v3/services/network` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.701447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c06c05-5b36-49fe-9051-6e64e8ab7f1f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:56.703124 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c06c05-5b36-49fe-9051-6e64e8ab7f1f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.710904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec166d7-f31f-4203-8626-d861ceea0dc5 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:56.715606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-c6c06c05-5b36-49fe-9051-6e64e8ab7f1f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 06 12:41:56.717394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 427/836] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:56 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:56.722614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c06c05-5b36-49fe-9051-6e64e8ab7f1f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:56.749362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9e23d-1c2e-46c5-8cd8-01b485f7ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:56.750347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9e23d-1c2e-46c5-8cd8-01b485f7ec35 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.750347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9e23d-1c2e-46c5-8cd8-01b485f7ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.750621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9e23d-1c2e-46c5-8cd8-01b485f7ec35 None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.751388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9e23d-1c2e-46c5-8cd8-01b485f7ec35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:56.751695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9e23d-1c2e-46c5-8cd8-01b485f7ec35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:56.753147 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9e23d-1c2e-46c5-8cd8-01b485f7ec35 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.766120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 410/837] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:56.767271 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9e23d-1c2e-46c5-8cd8-01b485f7ec35 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:56.840847 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c06c05-5b36-49fe-9051-6e64e8ab7f1f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:56.876920 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9e23d-1c2e-46c5-8cd8-01b485f7ec35 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:56.877745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965a0da-fbe0-4bf7-82e7-576adf80c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:56.878789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965a0da-fbe0-4bf7-82e7-576adf80c81c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.879285 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965a0da-fbe0-4bf7-82e7-576adf80c81c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.879769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965a0da-fbe0-4bf7-82e7-576adf80c81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.895032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965a0da-fbe0-4bf7-82e7-576adf80c81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:56.896516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965a0da-fbe0-4bf7-82e7-576adf80c81c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.913851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77598ba5-3a72-4667-8d49-ed8cce70d065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:56.914045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-9965a0da-fbe0-4bf7-82e7-576adf80c81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:56.914952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77598ba5-3a72-4667-8d49-ed8cce70d065 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.915442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77598ba5-3a72-4667-8d49-ed8cce70d065 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.915938 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77598ba5-3a72-4667-8d49-ed8cce70d065 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.916845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77598ba5-3a72-4667-8d49-ed8cce70d065 None admin] RBAC: Adding query filter params (name=network) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:56.917157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77598ba5-3a72-4667-8d49-ed8cce70d065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:56.919251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 428/838] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:56.919251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965a0da-fbe0-4bf7-82e7-576adf80c81c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:56.919460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77598ba5-3a72-4667-8d49-ed8cce70d065 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:56.924406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 411/839] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:41:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:56.925989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9cdeb-b287-4872-bca6-36d974dbb5cd None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:56.926278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9cdeb-b287-4872-bca6-36d974dbb5cd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:56.926558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9cdeb-b287-4872-bca6-36d974dbb5cd None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:56.931612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 412/840] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:56.931612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9cdeb-b287-4872-bca6-36d974dbb5cd None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:57.027034 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965a0da-fbe0-4bf7-82e7-576adf80c81c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:57.030694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9cdeb-b287-4872-bca6-36d974dbb5cd None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:57.065787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acef9dc-289a-4eba-9f05-0a51d7d5e5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:57.067143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acef9dc-289a-4eba-9f05-0a51d7d5e5fb None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:57.067599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acef9dc-289a-4eba-9f05-0a51d7d5e5fb None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:57.068064 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acef9dc-289a-4eba-9f05-0a51d7d5e5fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:57.069552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acef9dc-289a-4eba-9f05-0a51d7d5e5fb None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=65b295446c7741ea96caf60ac955d82d) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:57.070104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acef9dc-289a-4eba-9f05-0a51d7d5e5fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:57.072635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acef9dc-289a-4eba-9f05-0a51d7d5e5fb None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:57.073203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34298c7-6968-452f-8e85-3cb122beea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:57.075305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34298c7-6968-452f-8e85-3cb122beea73 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:57.075952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34298c7-6968-452f-8e85-3cb122beea73 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:57.077286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34298c7-6968-452f-8e85-3cb122beea73 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:57.078550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34298c7-6968-452f-8e85-3cb122beea73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:57.079246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34298c7-6968-452f-8e85-3cb122beea73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:57.081794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34298c7-6968-452f-8e85-3cb122beea73 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:57.082510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 429/841] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:56 2022] GET /identity/v3/role_assignments?user.id=65b295446c7741ea96caf60ac955d82d&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=c158bb1781c44a03890992161076b84b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:57.083760 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acef9dc-289a-4eba-9f05-0a51d7d5e5fb None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:57.097875 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 413/842] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:57.107210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6aec6-1d35-4123-9151-4b35d6d40a5c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:57.107761 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6aec6-1d35-4123-9151-4b35d6d40a5c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:57.108190 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6aec6-1d35-4123-9151-4b35d6d40a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:57.126551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-31c6aec6-1d35-4123-9151-4b35d6d40a5c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:57.128030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-31c6aec6-1d35-4123-9151-4b35d6d40a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:57.202705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 414/843] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:41:57.204387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6aec6-1d35-4123-9151-4b35d6d40a5c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:57.236854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acef9dc-289a-4eba-9f05-0a51d7d5e5fb None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:57.286904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706128ea-81dc-40ce-8afe-4c0f921b119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:57.287919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706128ea-81dc-40ce-8afe-4c0f921b119f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:57.288410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706128ea-81dc-40ce-8afe-4c0f921b119f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:57.288903 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706128ea-81dc-40ce-8afe-4c0f921b119f None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:57.289860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706128ea-81dc-40ce-8afe-4c0f921b119f None admin] RBAC: Adding query filter params (type=network) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:57.290411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706128ea-81dc-40ce-8afe-4c0f921b119f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:57.292049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706128ea-81dc-40ce-8afe-4c0f921b119f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:57.299732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 430/844] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:41:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:57.300920 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706128ea-81dc-40ce-8afe-4c0f921b119f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:57.311959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6aec6-1d35-4123-9151-4b35d6d40a5c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:57.356267 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea7a15-4200-4a9a-b3b0-f249ed392edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:57.357212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea7a15-4200-4a9a-b3b0-f249ed392edc None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:57.357633 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea7a15-4200-4a9a-b3b0-f249ed392edc None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:57.357996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea7a15-4200-4a9a-b3b0-f249ed392edc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:57.365070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea7a15-4200-4a9a-b3b0-f249ed392edc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:57.366896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea7a15-4200-4a9a-b3b0-f249ed392edc None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:57.381315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-fcea7a15-4200-4a9a-b3b0-f249ed392edc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:57.382736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 415/845] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:57.383556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea7a15-4200-4a9a-b3b0-f249ed392edc None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:57.436543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706128ea-81dc-40ce-8afe-4c0f921b119f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:57.469644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76419-a725-4b75-8432-0e9f1f877e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:57.470354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76419-a725-4b75-8432-0e9f1f877e9b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:57.470633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76419-a725-4b75-8432-0e9f1f877e9b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:57.471016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d76419-a725-4b75-8432-0e9f1f877e9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:57.483474 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d76419-a725-4b75-8432-0e9f1f877e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:41:57.490573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-a4d76419-a725-4b75-8432-0e9f1f877e9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:41:57.491955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 431/846] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:57.492557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76419-a725-4b75-8432-0e9f1f877e9b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:57.510713 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea7a15-4200-4a9a-b3b0-f249ed392edc None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:57.546120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202538ae-c9a8-4cd7-87c4-5e20e80fb6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:57.546789 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202538ae-c9a8-4cd7-87c4-5e20e80fb6d2 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:57.547076 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202538ae-c9a8-4cd7-87c4-5e20e80fb6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:57.547356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202538ae-c9a8-4cd7-87c4-5e20e80fb6d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:57.548108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202538ae-c9a8-4cd7-87c4-5e20e80fb6d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:57.549779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202538ae-c9a8-4cd7-87c4-5e20e80fb6d2 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:57.572798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 416/847] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Apr 6 12:41:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:41:57.582592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202538ae-c9a8-4cd7-87c4-5e20e80fb6d2 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:57.600394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d76419-a725-4b75-8432-0e9f1f877e9b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:57.644314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7d665-2ee2-4b64-91f4-259df289d0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:57.645066 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7d665-2ee2-4b64-91f4-259df289d0ae None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:57.645351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7d665-2ee2-4b64-91f4-259df289d0ae None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:57.645669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7d665-2ee2-4b64-91f4-259df289d0ae None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:57.646510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7d665-2ee2-4b64-91f4-259df289d0ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:57.646820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7d665-2ee2-4b64-91f4-259df289d0ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:57.648377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7d665-2ee2-4b64-91f4-259df289d0ae None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:57.669319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 432/848] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:57.677315 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7d665-2ee2-4b64-91f4-259df289d0ae None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:57.814737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202538ae-c9a8-4cd7-87c4-5e20e80fb6d2 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:57.876030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7d665-2ee2-4b64-91f4-259df289d0ae None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:57.882831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7fda2-fe04-4036-a7a3-48b379402e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:57.883507 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7fda2-fe04-4036-a7a3-48b379402e21 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:57.883786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7fda2-fe04-4036-a7a3-48b379402e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:57.884057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7fda2-fe04-4036-a7a3-48b379402e21 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:57.884803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7fda2-fe04-4036-a7a3-48b379402e21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:57.885164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7fda2-fe04-4036-a7a3-48b379402e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:57.887615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7fda2-fe04-4036-a7a3-48b379402e21 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:57.896699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 417/849] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:41:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:57.906051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7fda2-fe04-4036-a7a3-48b379402e21 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:57.919317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7dde8-719c-445b-9b66-c8526a37fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:57.920202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7dde8-719c-445b-9b66-c8526a37fede None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:57.920323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7dde8-719c-445b-9b66-c8526a37fede None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:57.920520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7dde8-719c-445b-9b66-c8526a37fede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:57.921487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7dde8-719c-445b-9b66-c8526a37fede None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=dc8964c44ba54772b29ca1e584be8c12) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:57.921689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7dde8-719c-445b-9b66-c8526a37fede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:57.923077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7dde8-719c-445b-9b66-c8526a37fede None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:57.929472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 433/850] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:57 2022] GET /identity/v3/role_assignments?user.id=dc8964c44ba54772b29ca1e584be8c12&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:58.024698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7fda2-fe04-4036-a7a3-48b379402e21 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:58.082129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ccda-c36f-4b04-8356-72d45aa518de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:58.083257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ccda-c36f-4b04-8356-72d45aa518de None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:58.083681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ccda-c36f-4b04-8356-72d45aa518de None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:58.084083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49ccda-c36f-4b04-8356-72d45aa518de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:58.099600 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49ccda-c36f-4b04-8356-72d45aa518de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:58.101478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49ccda-c36f-4b04-8356-72d45aa518de None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:58.120407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-fa49ccda-c36f-4b04-8356-72d45aa518de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:58.122948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 418/851] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:58.129603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7dde8-719c-445b-9b66-c8526a37fede None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:58.229239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7dde8-719c-445b-9b66-c8526a37fede None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:58.266394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79096c-981c-40b1-9ca7-e13ebd884027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:58.267058 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79096c-981c-40b1-9ca7-e13ebd884027 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:58.267334 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79096c-981c-40b1-9ca7-e13ebd884027 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:58.267700 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79096c-981c-40b1-9ca7-e13ebd884027 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:58.268318 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79096c-981c-40b1-9ca7-e13ebd884027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:58.268622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79096c-981c-40b1-9ca7-e13ebd884027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:58.270020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79096c-981c-40b1-9ca7-e13ebd884027 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:58.281882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 434/852] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:58.287299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ccda-c36f-4b04-8356-72d45aa518de None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:58.393339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49ccda-c36f-4b04-8356-72d45aa518de None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:58.439327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3464899-03c6-4262-a0cb-5e3642f262f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:58.440414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464899-03c6-4262-a0cb-5e3642f262f5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:58.440890 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464899-03c6-4262-a0cb-5e3642f262f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:58.441341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3464899-03c6-4262-a0cb-5e3642f262f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:58.450293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3464899-03c6-4262-a0cb-5e3642f262f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:58.451995 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3464899-03c6-4262-a0cb-5e3642f262f5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:58.465944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-c3464899-03c6-4262-a0cb-5e3642f262f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 06 12:41:58.467690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 419/853] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:41:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:58.473636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79096c-981c-40b1-9ca7-e13ebd884027 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:58.575946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79096c-981c-40b1-9ca7-e13ebd884027 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:58.610119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634bfff-23b1-4902-9b60-5f282078e6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:58.610789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634bfff-23b1-4902-9b60-5f282078e6e7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:58.611071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634bfff-23b1-4902-9b60-5f282078e6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:58.611350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1634bfff-23b1-4902-9b60-5f282078e6e7 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:58.612186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634bfff-23b1-4902-9b60-5f282078e6e7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:58.612496 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634bfff-23b1-4902-9b60-5f282078e6e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:58.613963 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1634bfff-23b1-4902-9b60-5f282078e6e7 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:58.631561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 435/854] 10.222.0.23 () {56 vars in 1135 bytes} [Wed Apr 6 12:41:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:58.637136 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3464899-03c6-4262-a0cb-5e3642f262f5 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:58.757172 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3464899-03c6-4262-a0cb-5e3642f262f5 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:58.794135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0026af-8928-4bd9-a7b6-c260f6c8d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:58.795107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0026af-8928-4bd9-a7b6-c260f6c8d578 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:58.795567 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0026af-8928-4bd9-a7b6-c260f6c8d578 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:58.796030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0026af-8928-4bd9-a7b6-c260f6c8d578 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:58.867670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0026af-8928-4bd9-a7b6-c260f6c8d578 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:58.869177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0026af-8928-4bd9-a7b6-c260f6c8d578 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:58.971529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 420/855] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:41:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:41:58.976833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634bfff-23b1-4902-9b60-5f282078e6e7 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:59.082101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1634bfff-23b1-4902-9b60-5f282078e6e7 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:59.116960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa8ad7-2e68-4a54-be8c-b3d051b98e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:59.117827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa8ad7-2e68-4a54-be8c-b3d051b98e81 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.118151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa8ad7-2e68-4a54-be8c-b3d051b98e81 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.118434 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa8ad7-2e68-4a54-be8c-b3d051b98e81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.129927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa8ad7-2e68-4a54-be8c-b3d051b98e81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:59.131391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa8ad7-2e68-4a54-be8c-b3d051b98e81 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:59.149516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-a0fa8ad7-2e68-4a54-be8c-b3d051b98e81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:41:59.151119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 436/856] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:59.157050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0026af-8928-4bd9-a7b6-c260f6c8d578 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:59.178055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec90ab-4242-4ece-9d72-fba43c5e5f9b None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.178341 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec90ab-4242-4ece-9d72-fba43c5e5f9b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.178621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec90ab-4242-4ece-9d72-fba43c5e5f9b None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.180277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 437/857] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:41:59.186360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0d6a7-662b-4bd0-9259-f139a190ecf2 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.186708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0d6a7-662b-4bd0-9259-f139a190ecf2 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.186992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0d6a7-662b-4bd0-9259-f139a190ecf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.205093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-60c0d6a7-662b-4bd0-9259-f139a190ecf2 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:59.206384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-60c0d6a7-662b-4bd0-9259-f139a190ecf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:59.273804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0026af-8928-4bd9-a7b6-c260f6c8d578 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:59.293715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 438/858] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:41:59.312966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d21f5-bd20-4d89-bd3a-817585e02da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:59.313767 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d21f5-bd20-4d89-bd3a-817585e02da5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.314139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d21f5-bd20-4d89-bd3a-817585e02da5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.314425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d21f5-bd20-4d89-bd3a-817585e02da5 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.315156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d21f5-bd20-4d89-bd3a-817585e02da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:59.315559 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d21f5-bd20-4d89-bd3a-817585e02da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:59.316555 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0d6a7-662b-4bd0-9259-f139a190ecf2 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:59.316960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d21f5-bd20-4d89-bd3a-817585e02da5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:59.330310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 421/859] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:59.336066 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d21f5-bd20-4d89-bd3a-817585e02da5 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:59.426247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0d6a7-662b-4bd0-9259-f139a190ecf2 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:59.446953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d21f5-bd20-4d89-bd3a-817585e02da5 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:59.486865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd4c7d-16fc-4f5f-9381-ddaddcc4e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:59.488498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd4c7d-16fc-4f5f-9381-ddaddcc4e4ac None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.489206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd4c7d-16fc-4f5f-9381-ddaddcc4e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.489365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a66e0a-6df9-4308-b887-c83bb4853b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:59.490088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd4c7d-16fc-4f5f-9381-ddaddcc4e4ac None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.490230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a66e0a-6df9-4308-b887-c83bb4853b7f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.490523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a66e0a-6df9-4308-b887-c83bb4853b7f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.491041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a66e0a-6df9-4308-b887-c83bb4853b7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.491768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd4c7d-16fc-4f5f-9381-ddaddcc4e4ac None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:59.494772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd4c7d-16fc-4f5f-9381-ddaddcc4e4ac None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:59.500485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a66e0a-6df9-4308-b887-c83bb4853b7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:59.502631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a66e0a-6df9-4308-b887-c83bb4853b7f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:59.511250 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-bddd4c7d-16fc-4f5f-9381-ddaddcc4e4ac None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 06 12:41:59.513382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 439/860] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:41:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:41:59.518478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-14a66e0a-6df9-4308-b887-c83bb4853b7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:41:59.520149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd4c7d-16fc-4f5f-9381-ddaddcc4e4ac None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:59.524755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 422/861] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:41:59.527398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a66e0a-6df9-4308-b887-c83bb4853b7f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:59.646721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a66e0a-6df9-4308-b887-c83bb4853b7f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:59.649242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd4c7d-16fc-4f5f-9381-ddaddcc4e4ac None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:59.690577 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713069-bf3c-430b-8d09-0ff3f52161bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:59.690804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d5947-e8a1-46a4-89ae-5082612b14f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:59.691263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713069-bf3c-430b-8d09-0ff3f52161bc None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.691457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5947-e8a1-46a4-89ae-5082612b14f3 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.691562 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713069-bf3c-430b-8d09-0ff3f52161bc None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.691761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5947-e8a1-46a4-89ae-5082612b14f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.691881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713069-bf3c-430b-8d09-0ff3f52161bc None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.691972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5947-e8a1-46a4-89ae-5082612b14f3 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.692671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5947-e8a1-46a4-89ae-5082612b14f3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:59.692769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c713069-bf3c-430b-8d09-0ff3f52161bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:59.692971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5947-e8a1-46a4-89ae-5082612b14f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:59.693090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c713069-bf3c-430b-8d09-0ff3f52161bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:59.694371 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5947-e8a1-46a4-89ae-5082612b14f3 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:59.694783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c713069-bf3c-430b-8d09-0ff3f52161bc None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:59.705860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 440/862] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:41:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:59.705860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2039-087d-4e2b-9244-64d421b0006b None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.705860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2039-087d-4e2b-9244-64d421b0006b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.705860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c2039-087d-4e2b-9244-64d421b0006b None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.705860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 441/863] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:41:59.706694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c2039-087d-4e2b-9244-64d421b0006b None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:59.713619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 423/864] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:59.716971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28a24-edc7-4632-8906-ae9e6df8833e None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.716971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28a24-edc7-4632-8906-ae9e6df8833e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.716971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28a24-edc7-4632-8906-ae9e6df8833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.732707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-eca28a24-edc7-4632-8906-ae9e6df8833e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:41:59.733838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-eca28a24-edc7-4632-8906-ae9e6df8833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:41:59.802154 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 424/865] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:41:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:41:59.813800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28a24-edc7-4632-8906-ae9e6df8833e None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:59.835573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c2039-087d-4e2b-9244-64d421b0006b None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:59.879430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59be945-0137-46be-b000-7597327b3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:59.880091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59be945-0137-46be-b000-7597327b3f34 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.880372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59be945-0137-46be-b000-7597327b3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.880649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59be945-0137-46be-b000-7597327b3f34 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.881349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59be945-0137-46be-b000-7597327b3f34 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:59.881768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59be945-0137-46be-b000-7597327b3f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:59.883137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59be945-0137-46be-b000-7597327b3f34 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:59.888192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 442/866] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:41:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:41:59.888976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59be945-0137-46be-b000-7597327b3f34 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:41:59.925833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28a24-edc7-4632-8906-ae9e6df8833e None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:41:59.965968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672cb2-550c-4933-adf3-945deb6bcf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:41:59.966716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672cb2-550c-4933-adf3-945deb6bcf6d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:41:59.966996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672cb2-550c-4933-adf3-945deb6bcf6d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:41:59.967266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44672cb2-550c-4933-adf3-945deb6bcf6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:41:59.968108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672cb2-550c-4933-adf3-945deb6bcf6d None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=0118661184dc4cb198f65e831fb1fe8f) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:41:59.968416 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672cb2-550c-4933-adf3-945deb6bcf6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:41:59.969948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44672cb2-550c-4933-adf3-945deb6bcf6d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:41:59.986042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 425/867] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:41:59 2022] GET /identity/v3/role_assignments?user.id=0118661184dc4cb198f65e831fb1fe8f&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=c158bb1781c44a03890992161076b84b => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:00.026542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59be945-0137-46be-b000-7597327b3f34 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:00.069931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3dda4-f1bf-454d-adf8-11da3acc15eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:00.071357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3dda4-f1bf-454d-adf8-11da3acc15eb None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:00.071902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3dda4-f1bf-454d-adf8-11da3acc15eb None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:00.072379 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3dda4-f1bf-454d-adf8-11da3acc15eb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:00.073283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3dda4-f1bf-454d-adf8-11da3acc15eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:00.075200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3dda4-f1bf-454d-adf8-11da3acc15eb None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:00.090151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-25e3dda4-f1bf-454d-adf8-11da3acc15eb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 06 12:42:00.092206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 443/868] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Apr 6 12:41:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:00.100476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672cb2-550c-4933-adf3-945deb6bcf6d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:00.227424 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44672cb2-550c-4933-adf3-945deb6bcf6d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:00.265704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2388d4-5846-4d0b-91b1-cb993402fb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:00.266439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2388d4-5846-4d0b-91b1-cb993402fb2a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:00.266727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2388d4-5846-4d0b-91b1-cb993402fb2a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:00.267064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2388d4-5846-4d0b-91b1-cb993402fb2a None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:00.267834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2388d4-5846-4d0b-91b1-cb993402fb2a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:00.268198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2388d4-5846-4d0b-91b1-cb993402fb2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:00.269809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2388d4-5846-4d0b-91b1-cb993402fb2a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:00.275283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 426/869] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:00.281946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3dda4-f1bf-454d-adf8-11da3acc15eb None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:00.386415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3dda4-f1bf-454d-adf8-11da3acc15eb None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:00.420089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b56042-4d34-453a-9816-c6d1543aa1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:00.421605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b56042-4d34-453a-9816-c6d1543aa1ab None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:00.422276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b56042-4d34-453a-9816-c6d1543aa1ab None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:00.422957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b56042-4d34-453a-9816-c6d1543aa1ab None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:00.424339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b56042-4d34-453a-9816-c6d1543aa1ab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:00.425438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b56042-4d34-453a-9816-c6d1543aa1ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:00.427421 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b56042-4d34-453a-9816-c6d1543aa1ab None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:00.433379 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 444/870] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:00.533901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7948cd-93a9-4792-89fa-19a5a69c4779 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:00.534407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7948cd-93a9-4792-89fa-19a5a69c4779 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:00.534883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7948cd-93a9-4792-89fa-19a5a69c4779 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:00.537860 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 427/871] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:00.548037 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999a4e-8aff-4452-8e8a-18036b11068d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:00.548537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999a4e-8aff-4452-8e8a-18036b11068d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:00.549031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999a4e-8aff-4452-8e8a-18036b11068d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:00.579676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-20999a4e-8aff-4452-8e8a-18036b11068d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:00.581809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-20999a4e-8aff-4452-8e8a-18036b11068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:00.688638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 445/872] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:00.713713 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7948cd-93a9-4792-89fa-19a5a69c4779 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:00.826851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7948cd-93a9-4792-89fa-19a5a69c4779 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:00.861185 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ed40d-d87b-40fc-8412-c0875cbb0628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:00.862035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed40d-d87b-40fc-8412-c0875cbb0628 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:00.862324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed40d-d87b-40fc-8412-c0875cbb0628 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:00.862602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ed40d-d87b-40fc-8412-c0875cbb0628 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:00.875811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ed40d-d87b-40fc-8412-c0875cbb0628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:00.883277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-024ed40d-d87b-40fc-8412-c0875cbb0628 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 12:42:00.884828 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 428/873] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Apr 6 12:42:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:00.891668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999a4e-8aff-4452-8e8a-18036b11068d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:00.995223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999a4e-8aff-4452-8e8a-18036b11068d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:01.052844 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fa3ab-897b-4c7a-8a05-0347356934fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:01.055020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fa3ab-897b-4c7a-8a05-0347356934fe None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:01.055720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fa3ab-897b-4c7a-8a05-0347356934fe None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:01.056406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fa3ab-897b-4c7a-8a05-0347356934fe None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:01.058601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fa3ab-897b-4c7a-8a05-0347356934fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:01.059356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fa3ab-897b-4c7a-8a05-0347356934fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:01.062023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fa3ab-897b-4c7a-8a05-0347356934fe None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:01.077464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 446/874] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Apr 6 12:42:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:01.082473 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ed40d-d87b-40fc-8412-c0875cbb0628 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:01.196485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ed40d-d87b-40fc-8412-c0875cbb0628 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:01.233743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702f3ea-84af-401b-bdb0-5485cd25877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:01.234558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702f3ea-84af-401b-bdb0-5485cd25877e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:01.234845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702f3ea-84af-401b-bdb0-5485cd25877e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:01.235123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702f3ea-84af-401b-bdb0-5485cd25877e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:01.246837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702f3ea-84af-401b-bdb0-5485cd25877e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:01.248334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702f3ea-84af-401b-bdb0-5485cd25877e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:01.266523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-0702f3ea-84af-401b-bdb0-5485cd25877e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:01.268062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 429/875] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:01.273598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fa3ab-897b-4c7a-8a05-0347356934fe None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:01.384567 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fa3ab-897b-4c7a-8a05-0347356934fe None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:01.420873 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc50f45-f780-4f7b-9e2b-cd3285080576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:01.421597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc50f45-f780-4f7b-9e2b-cd3285080576 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:01.421906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc50f45-f780-4f7b-9e2b-cd3285080576 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:01.422186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc50f45-f780-4f7b-9e2b-cd3285080576 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:01.423043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc50f45-f780-4f7b-9e2b-cd3285080576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:01.423357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc50f45-f780-4f7b-9e2b-cd3285080576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:01.424987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc50f45-f780-4f7b-9e2b-cd3285080576 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:01.438265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 447/876] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:01.443673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702f3ea-84af-401b-bdb0-5485cd25877e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:01.551436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702f3ea-84af-401b-bdb0-5485cd25877e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:01.587310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b6650-bd18-4a3e-90cf-e3e3f122e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:01.588054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6650-bd18-4a3e-90cf-e3e3f122e92c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:01.588338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6650-bd18-4a3e-90cf-e3e3f122e92c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:01.588613 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6650-bd18-4a3e-90cf-e3e3f122e92c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:01.597795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b6650-bd18-4a3e-90cf-e3e3f122e92c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:01.599365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b6650-bd18-4a3e-90cf-e3e3f122e92c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:01.614615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-3d9b6650-bd18-4a3e-90cf-e3e3f122e92c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 12:42:01.616206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 430/877] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Apr 6 12:42:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:01.622367 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc50f45-f780-4f7b-9e2b-cd3285080576 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:01.731554 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc50f45-f780-4f7b-9e2b-cd3285080576 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:01.768904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9330f32-c198-4381-8451-84d66ca9f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:01.769662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9330f32-c198-4381-8451-84d66ca9f44c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:01.769980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9330f32-c198-4381-8451-84d66ca9f44c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:01.770222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9330f32-c198-4381-8451-84d66ca9f44c None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:01.771146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9330f32-c198-4381-8451-84d66ca9f44c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:01.771455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9330f32-c198-4381-8451-84d66ca9f44c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:01.772940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9330f32-c198-4381-8451-84d66ca9f44c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:01.792267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 448/878] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Apr 6 12:42:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:01.798618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b6650-bd18-4a3e-90cf-e3e3f122e92c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:01.906025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b6650-bd18-4a3e-90cf-e3e3f122e92c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:01.942095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d25878-029f-4fd7-b582-100d1bb1e779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:01.942837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d25878-029f-4fd7-b582-100d1bb1e779 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:01.943124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d25878-029f-4fd7-b582-100d1bb1e779 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:01.943403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d25878-029f-4fd7-b582-100d1bb1e779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:02.020395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d25878-029f-4fd7-b582-100d1bb1e779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:02.021919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d25878-029f-4fd7-b582-100d1bb1e779 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:02.123477 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 431/879] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:42:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:42:02.128949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9330f32-c198-4381-8451-84d66ca9f44c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:02.238028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9330f32-c198-4381-8451-84d66ca9f44c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:02.279586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040cef3-576b-4eaf-9070-0be8f7965a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:02.281119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040cef3-576b-4eaf-9070-0be8f7965a51 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:02.281543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040cef3-576b-4eaf-9070-0be8f7965a51 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:02.281856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040cef3-576b-4eaf-9070-0be8f7965a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:02.293162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040cef3-576b-4eaf-9070-0be8f7965a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:02.294726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040cef3-576b-4eaf-9070-0be8f7965a51 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:02.320345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-3040cef3-576b-4eaf-9070-0be8f7965a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:02.322643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 449/880] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:02.331018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d25878-029f-4fd7-b582-100d1bb1e779 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:02.371275 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572b1a-4ca6-4d14-9128-bee2aeab3ee0 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:02.371908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572b1a-4ca6-4d14-9128-bee2aeab3ee0 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:02.372484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51572b1a-4ca6-4d14-9128-bee2aeab3ee0 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:02.378049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 450/881] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:02.379964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb5fd-5030-4c98-9c55-39c6d6a70d52 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:02.380471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb5fd-5030-4c98-9c55-39c6d6a70d52 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:02.380954 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abb5fd-5030-4c98-9c55-39c6d6a70d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:02.400406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b8abb5fd-5030-4c98-9c55-39c6d6a70d52 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:02.402495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b8abb5fd-5030-4c98-9c55-39c6d6a70d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:02.451251 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d25878-029f-4fd7-b582-100d1bb1e779 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:02.485047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 451/882] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:02.488096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc3e62-a19e-43d9-84bd-ca0e5e97b05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:02.488709 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3e62-a19e-43d9-84bd-ca0e5e97b05c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:02.488988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3e62-a19e-43d9-84bd-ca0e5e97b05c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:02.489258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3e62-a19e-43d9-84bd-ca0e5e97b05c None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:02.490007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc3e62-a19e-43d9-84bd-ca0e5e97b05c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:02.490314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc3e62-a19e-43d9-84bd-ca0e5e97b05c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:02.491730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc3e62-a19e-43d9-84bd-ca0e5e97b05c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:02.505399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 432/883] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:02.506580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abb5fd-5030-4c98-9c55-39c6d6a70d52 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:02.511260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc3e62-a19e-43d9-84bd-ca0e5e97b05c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:02.622737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abb5fd-5030-4c98-9c55-39c6d6a70d52 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:02.631963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc3e62-a19e-43d9-84bd-ca0e5e97b05c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:02.663867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19be9b-3b97-4f94-b622-0f06c592b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:02.664921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19be9b-3b97-4f94-b622-0f06c592b382 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:02.665298 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19be9b-3b97-4f94-b622-0f06c592b382 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:02.665834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19be9b-3b97-4f94-b622-0f06c592b382 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:02.666792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19be9b-3b97-4f94-b622-0f06c592b382 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:02.669379 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19be9b-3b97-4f94-b622-0f06c592b382 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:02.670155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0831f-ee2b-4e70-addb-359fd358986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:02.671071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0831f-ee2b-4e70-addb-359fd358986f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:02.671349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0831f-ee2b-4e70-addb-359fd358986f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:02.671627 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0831f-ee2b-4e70-addb-359fd358986f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:02.682319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0831f-ee2b-4e70-addb-359fd358986f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:02.684703 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0831f-ee2b-4e70-addb-359fd358986f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:02.696070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 452/884] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:42:02 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:02.696070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3424-b9c9-4eda-9e52-1994126a9c45 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:02.696070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3424-b9c9-4eda-9e52-1994126a9c45 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:02.696070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a3424-b9c9-4eda-9e52-1994126a9c45 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:02.696070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 453/885] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:02.698433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187388b1-cd85-489e-a2ba-77847ab47560 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:02.699510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187388b1-cd85-489e-a2ba-77847ab47560 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:02.700171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187388b1-cd85-489e-a2ba-77847ab47560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:02.708391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-f0e0831f-ee2b-4e70-addb-359fd358986f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:42:02.711413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 433/886] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:42:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:02.717076 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0831f-ee2b-4e70-addb-359fd358986f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:02.722501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-187388b1-cd85-489e-a2ba-77847ab47560 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:02.723752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-187388b1-cd85-489e-a2ba-77847ab47560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:02.829617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 454/887] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:02.846904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0831f-ee2b-4e70-addb-359fd358986f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:02.853099 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187388b1-cd85-489e-a2ba-77847ab47560 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:02.896177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bed6ec-6e28-4a2c-99a8-baa6358cfbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:02.897264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bed6ec-6e28-4a2c-99a8-baa6358cfbd3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:02.897840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bed6ec-6e28-4a2c-99a8-baa6358cfbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:02.898451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bed6ec-6e28-4a2c-99a8-baa6358cfbd3 None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:02.899489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bed6ec-6e28-4a2c-99a8-baa6358cfbd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:02.900015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bed6ec-6e28-4a2c-99a8-baa6358cfbd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:02.901852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bed6ec-6e28-4a2c-99a8-baa6358cfbd3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:02.919624 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 434/888] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:02.925783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bed6ec-6e28-4a2c-99a8-baa6358cfbd3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:02.986742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187388b1-cd85-489e-a2ba-77847ab47560 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:03.023193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c020b-d93b-4554-bad4-233220b4c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:03.024513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c020b-d93b-4554-bad4-233220b4c777 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:03.025006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c020b-d93b-4554-bad4-233220b4c777 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:03.025495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c020b-d93b-4554-bad4-233220b4c777 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:03.027291 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c020b-d93b-4554-bad4-233220b4c777 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:03.029955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c020b-d93b-4554-bad4-233220b4c777 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:03.052310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-ef9c020b-d93b-4554-bad4-233220b4c777 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 12:42:03.054926 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 455/889] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:03.063098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c020b-d93b-4554-bad4-233220b4c777 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:03.069626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bed6ec-6e28-4a2c-99a8-baa6358cfbd3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:03.107291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88469a6f-fcde-48ca-9bfa-22055707b69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:03.107915 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88469a6f-fcde-48ca-9bfa-22055707b69c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:03.108202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88469a6f-fcde-48ca-9bfa-22055707b69c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:03.108477 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88469a6f-fcde-48ca-9bfa-22055707b69c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:03.109316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88469a6f-fcde-48ca-9bfa-22055707b69c None admin] RBAC: Adding query filter params (role.id=4900702c949549fd854b71b99b8faffb, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=dc8964c44ba54772b29ca1e584be8c12) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:03.109672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88469a6f-fcde-48ca-9bfa-22055707b69c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:03.111222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88469a6f-fcde-48ca-9bfa-22055707b69c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:03.121668 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 435/890] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:42:02 2022] GET /identity/v3/role_assignments?user.id=dc8964c44ba54772b29ca1e584be8c12&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=4900702c949549fd854b71b99b8faffb => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:03.128652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efbe8c-7296-4dc1-ba25-0a841a50cafe None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:03.129139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efbe8c-7296-4dc1-ba25-0a841a50cafe None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:03.129665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efbe8c-7296-4dc1-ba25-0a841a50cafe None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:03.137771 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 436/891] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:42:03.139631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62044b35-e2c3-49f2-a2db-678ad0353dc9 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:03.139935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62044b35-e2c3-49f2-a2db-678ad0353dc9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:03.140201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62044b35-e2c3-49f2-a2db-678ad0353dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:03.163551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-62044b35-e2c3-49f2-a2db-678ad0353dc9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:03.164872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-62044b35-e2c3-49f2-a2db-678ad0353dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:03.222029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c020b-d93b-4554-bad4-233220b4c777 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:03.265213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473411c-6181-4644-b0b4-09586cedca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:03.267043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473411c-6181-4644-b0b4-09586cedca87 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:03.267854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473411c-6181-4644-b0b4-09586cedca87 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:03.273599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 437/892] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:03 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:03.273823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5473411c-6181-4644-b0b4-09586cedca87 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:03.273823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473411c-6181-4644-b0b4-09586cedca87 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:03.273823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473411c-6181-4644-b0b4-09586cedca87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:03.273823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5473411c-6181-4644-b0b4-09586cedca87 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:03.279571 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 456/893] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Apr 6 12:42:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:03.285472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62044b35-e2c3-49f2-a2db-678ad0353dc9 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:03.302325 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473411c-6181-4644-b0b4-09586cedca87 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:03.408406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62044b35-e2c3-49f2-a2db-678ad0353dc9 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:03.453231 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cb0a9-20c6-4043-a21a-ce5c6bb7ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:03.454322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb0a9-20c6-4043-a21a-ce5c6bb7ad2d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:03.454803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb0a9-20c6-4043-a21a-ce5c6bb7ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:03.455267 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cb0a9-20c6-4043-a21a-ce5c6bb7ad2d None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:03.456050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5473411c-6181-4644-b0b4-09586cedca87 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:03.456539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cb0a9-20c6-4043-a21a-ce5c6bb7ad2d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:03.457106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cb0a9-20c6-4043-a21a-ce5c6bb7ad2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:03.459711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cb0a9-20c6-4043-a21a-ce5c6bb7ad2d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:03.467357 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 438/894] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Apr 6 12:42:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:03.500302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ba33f-283b-4c95-9788-4c45142ac114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:03.501244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ba33f-283b-4c95-9788-4c45142ac114 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:03.501704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ba33f-283b-4c95-9788-4c45142ac114 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:03.502155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ba33f-283b-4c95-9788-4c45142ac114 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:03.503127 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ba33f-283b-4c95-9788-4c45142ac114 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:03.504806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ba33f-283b-4c95-9788-4c45142ac114 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:03.523290 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 457/895] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:42:03 2022] POST /identity/v3/services => generated 269 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:42:05.212991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935f626-b4db-4816-8776-929702c7b164 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:05.213737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935f626-b4db-4816-8776-929702c7b164 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:05.213737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935f626-b4db-4816-8776-929702c7b164 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:05.216409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 439/896] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:05.221810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4497f4-f2fa-4658-b38b-6d3ec01ff766 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:05.222380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4497f4-f2fa-4658-b38b-6d3ec01ff766 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:05.222380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4497f4-f2fa-4658-b38b-6d3ec01ff766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:05.240048 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-cc4497f4-f2fa-4658-b38b-6d3ec01ff766 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:05.241236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cc4497f4-f2fa-4658-b38b-6d3ec01ff766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:05.336910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 458/897] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:05.360417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935f626-b4db-4816-8776-929702c7b164 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:05.464635 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935f626-b4db-4816-8776-929702c7b164 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:05.498862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ed51a-d2b7-482d-90de-bd37559d1fc4 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:05.499156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ed51a-d2b7-482d-90de-bd37559d1fc4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:05.499434 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ed51a-d2b7-482d-90de-bd37559d1fc4 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:05.500110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46434a-c298-4f68-9aa7-7088bc19c648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:05.501045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 459/898] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:42:05.501273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46434a-c298-4f68-9aa7-7088bc19c648 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:05.501724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46434a-c298-4f68-9aa7-7088bc19c648 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:05.502197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46434a-c298-4f68-9aa7-7088bc19c648 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:05.503028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46434a-c298-4f68-9aa7-7088bc19c648 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:05.504639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46434a-c298-4f68-9aa7-7088bc19c648 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:05.506150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8e1c5-2d20-4fb3-875f-92936fcdeebf None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:05.506441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8e1c5-2d20-4fb3-875f-92936fcdeebf None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:05.506720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8e1c5-2d20-4fb3-875f-92936fcdeebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:05.516706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-8c46434a-c298-4f68-9aa7-7088bc19c648 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 06 12:42:05.523026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 440/899] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:42:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:05.523653 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-47e8e1c5-2d20-4fb3-875f-92936fcdeebf None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:05.524514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46434a-c298-4f68-9aa7-7088bc19c648 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:05.524845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-47e8e1c5-2d20-4fb3-875f-92936fcdeebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:05.605811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 460/900] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:05.630874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8e1c5-2d20-4fb3-875f-92936fcdeebf None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:05.636778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46434a-c298-4f68-9aa7-7088bc19c648 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:05.676865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611cef-01cf-4b50-955b-a03fb26b1643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:05.677980 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611cef-01cf-4b50-955b-a03fb26b1643 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:05.679067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611cef-01cf-4b50-955b-a03fb26b1643 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:05.679583 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611cef-01cf-4b50-955b-a03fb26b1643 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:05.680922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611cef-01cf-4b50-955b-a03fb26b1643 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:05.681468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611cef-01cf-4b50-955b-a03fb26b1643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:05.683944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611cef-01cf-4b50-955b-a03fb26b1643 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:05.691146 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 441/901] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:42:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:05.697297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611cef-01cf-4b50-955b-a03fb26b1643 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:05.746580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8e1c5-2d20-4fb3-875f-92936fcdeebf None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:05.783109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a8cf8-992f-45f6-83bd-bae3cac30a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:05.783927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a8cf8-992f-45f6-83bd-bae3cac30a7c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:05.784292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a8cf8-992f-45f6-83bd-bae3cac30a7c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:05.784474 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a8cf8-992f-45f6-83bd-bae3cac30a7c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:05.796370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a8cf8-992f-45f6-83bd-bae3cac30a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:05.804331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-a20a8cf8-992f-45f6-83bd-bae3cac30a7c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 12:42:05.807405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611cef-01cf-4b50-955b-a03fb26b1643 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:05.810939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 461/902] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Apr 6 12:42:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:05.811771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a8cf8-992f-45f6-83bd-bae3cac30a7c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:05.843619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d859-8cca-4f0f-b008-a43ed3fe084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:05.844678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d859-8cca-4f0f-b008-a43ed3fe084b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:05.845177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d859-8cca-4f0f-b008-a43ed3fe084b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:05.845696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d859-8cca-4f0f-b008-a43ed3fe084b None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:05.846610 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4d859-8cca-4f0f-b008-a43ed3fe084b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:05.847113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4d859-8cca-4f0f-b008-a43ed3fe084b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:05.848715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4d859-8cca-4f0f-b008-a43ed3fe084b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:05.859924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 442/903] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:42:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:05.861618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d859-8cca-4f0f-b008-a43ed3fe084b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:05.917007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a8cf8-992f-45f6-83bd-bae3cac30a7c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:05.952484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327c23-d7d8-49a5-bfb7-50d4aef16e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:05.953157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327c23-d7d8-49a5-bfb7-50d4aef16e87 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:05.953441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327c23-d7d8-49a5-bfb7-50d4aef16e87 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:05.953751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96327c23-d7d8-49a5-bfb7-50d4aef16e87 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:05.954512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327c23-d7d8-49a5-bfb7-50d4aef16e87 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:05.954823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327c23-d7d8-49a5-bfb7-50d4aef16e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:05.956218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96327c23-d7d8-49a5-bfb7-50d4aef16e87 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:05.968593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d859-8cca-4f0f-b008-a43ed3fe084b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:05.972051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 462/904] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Apr 6 12:42:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:05.972447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327c23-d7d8-49a5-bfb7-50d4aef16e87 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:06.004798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a369-10f3-493c-b654-f63ece18fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:06.005833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a369-10f3-493c-b654-f63ece18fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.006320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a369-10f3-493c-b654-f63ece18fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.006818 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a369-10f3-493c-b654-f63ece18fbb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.007815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0a369-10f3-493c-b654-f63ece18fbb8 None admin] RBAC: Adding query filter params (interface=public, service_id=f873530ccdfe4f6d8da1fba1ad23ba20, region_id=RegionOne) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:06.008329 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0a369-10f3-493c-b654-f63ece18fbb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:06.009963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0a369-10f3-493c-b654-f63ece18fbb8 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:06.020389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 443/905] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Apr 6 12:42:05 2022] GET /identity/v3/endpoints?service_id=f873530ccdfe4f6d8da1fba1ad23ba20&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:06.022046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a369-10f3-493c-b654-f63ece18fbb8 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:06.076391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96327c23-d7d8-49a5-bfb7-50d4aef16e87 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:06.115014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce52ad-e125-48e7-8a87-e4e70fa6e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:06.115810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce52ad-e125-48e7-8a87-e4e70fa6e91c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.116094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce52ad-e125-48e7-8a87-e4e70fa6e91c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.116370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce52ad-e125-48e7-8a87-e4e70fa6e91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.127048 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce52ad-e125-48e7-8a87-e4e70fa6e91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:06.128519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce52ad-e125-48e7-8a87-e4e70fa6e91c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:06.130253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a369-10f3-493c-b654-f63ece18fbb8 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:06.144747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-a3ce52ad-e125-48e7-8a87-e4e70fa6e91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:06.150226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 463/906] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:06.150226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ffe8a-2da2-4ad7-9a5a-50a7c82530c2 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.150226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ffe8a-2da2-4ad7-9a5a-50a7c82530c2 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.150226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ffe8a-2da2-4ad7-9a5a-50a7c82530c2 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.151042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 464/907] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:06.154428 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ffe8a-2da2-4ad7-9a5a-50a7c82530c2 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:06.170844 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0eafa-29d6-4b5f-8bd2-bccfb53f4101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:06.171568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0eafa-29d6-4b5f-8bd2-bccfb53f4101 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.171856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0eafa-29d6-4b5f-8bd2-bccfb53f4101 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.172139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0eafa-29d6-4b5f-8bd2-bccfb53f4101 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.172843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0eafa-29d6-4b5f-8bd2-bccfb53f4101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:06.174594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0eafa-29d6-4b5f-8bd2-bccfb53f4101 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:06.187599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 444/908] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Apr 6 12:42:06 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:42:06.187599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c91be-15eb-443e-af22-c1124071a2cf None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.187599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c91be-15eb-443e-af22-c1124071a2cf None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.187599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c91be-15eb-443e-af22-c1124071a2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.204958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-2e4c91be-15eb-443e-af22-c1124071a2cf None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:06.206354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2e4c91be-15eb-443e-af22-c1124071a2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:06.280018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ffe8a-2da2-4ad7-9a5a-50a7c82530c2 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:06.286074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 445/909] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:06.308438 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c91be-15eb-443e-af22-c1124071a2cf None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:06.318112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ffdae-a928-4ce1-91a7-2d447aef10df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:06.318535 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ffdae-a928-4ce1-91a7-2d447aef10df None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.318823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ffdae-a928-4ce1-91a7-2d447aef10df None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.319103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ffdae-a928-4ce1-91a7-2d447aef10df None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.319846 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ffdae-a928-4ce1-91a7-2d447aef10df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:06.320164 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ffdae-a928-4ce1-91a7-2d447aef10df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:06.321630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ffdae-a928-4ce1-91a7-2d447aef10df None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:06.335404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 465/910] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:06.342744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ffdae-a928-4ce1-91a7-2d447aef10df None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:06.447804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c91be-15eb-443e-af22-c1124071a2cf None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:06.461548 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ffdae-a928-4ce1-91a7-2d447aef10df None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:06.493409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb247c-40e6-4b96-bc9a-b07aeeb4dd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:06.495066 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb247c-40e6-4b96-bc9a-b07aeeb4dd6a None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.496836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb247c-40e6-4b96-bc9a-b07aeeb4dd6a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.497411 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb247c-40e6-4b96-bc9a-b07aeeb4dd6a None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.498398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb247c-40e6-4b96-bc9a-b07aeeb4dd6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:06.499819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb247c-40e6-4b96-bc9a-b07aeeb4dd6a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:06.500857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce1f93-f053-441c-8142-937853a07ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:06.502226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce1f93-f053-441c-8142-937853a07ab9 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.502714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce1f93-f053-441c-8142-937853a07ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.503185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce1f93-f053-441c-8142-937853a07ab9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.512310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce1f93-f053-441c-8142-937853a07ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:06.514074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce1f93-f053-441c-8142-937853a07ab9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:06.525236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 446/911] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:42:06 2022] POST /identity/v3/services => generated 241 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:42:06.538351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-7dce1f93-f053-441c-8142-937853a07ab9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 12:42:06.539927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 466/912] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Apr 6 12:42:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:06.546661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb247c-40e6-4b96-bc9a-b07aeeb4dd6a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:06.564138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f666-2271-4ddb-80f4-2a14666add9d None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.564477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f666-2271-4ddb-80f4-2a14666add9d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.564684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f666-2271-4ddb-80f4-2a14666add9d None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.570301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 467/913] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:42:06.571732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011e52f-416b-4915-a77f-7b106468f9e0 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.572057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011e52f-416b-4915-a77f-7b106468f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.572339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011e52f-416b-4915-a77f-7b106468f9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.589922 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-9011e52f-416b-4915-a77f-7b106468f9e0 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:06.591140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9011e52f-416b-4915-a77f-7b106468f9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:06.681958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb247c-40e6-4b96-bc9a-b07aeeb4dd6a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:06.688131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 468/914] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:06.711441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011e52f-416b-4915-a77f-7b106468f9e0 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:06.725371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b6d6-6cb6-4615-a373-00a11ff4c955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:06.726080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b6d6-6cb6-4615-a373-00a11ff4c955 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.726413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b6d6-6cb6-4615-a373-00a11ff4c955 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.726698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19b6d6-6cb6-4615-a373-00a11ff4c955 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.727482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19b6d6-6cb6-4615-a373-00a11ff4c955 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:06.727793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19b6d6-6cb6-4615-a373-00a11ff4c955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:06.729272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19b6d6-6cb6-4615-a373-00a11ff4c955 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:06.752513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 447/915] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Apr 6 12:42:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:06.758550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b6d6-6cb6-4615-a373-00a11ff4c955 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:06.834509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011e52f-416b-4915-a77f-7b106468f9e0 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:06.876597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19b6d6-6cb6-4615-a373-00a11ff4c955 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:06.878999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49daa7-c4b6-47ad-9b68-9f8a265b71fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:06.880449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49daa7-c4b6-47ad-9b68-9f8a265b71fe None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.881041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49daa7-c4b6-47ad-9b68-9f8a265b71fe None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.881629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49daa7-c4b6-47ad-9b68-9f8a265b71fe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.882448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49daa7-c4b6-47ad-9b68-9f8a265b71fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:06.883921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49daa7-c4b6-47ad-9b68-9f8a265b71fe None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:06.897326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-be49daa7-c4b6-47ad-9b68-9f8a265b71fe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 06 12:42:06.904166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 469/916] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Apr 6 12:42:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:06.905199 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49daa7-c4b6-47ad-9b68-9f8a265b71fe None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:06.912776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c938a4-e897-48d6-8186-37494124e90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:06.913908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c938a4-e897-48d6-8186-37494124e90d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:06.914333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c938a4-e897-48d6-8186-37494124e90d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:06.914750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c938a4-e897-48d6-8186-37494124e90d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:06.925808 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c938a4-e897-48d6-8186-37494124e90d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:06.927538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c938a4-e897-48d6-8186-37494124e90d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:06.945325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-10c938a4-e897-48d6-8186-37494124e90d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:06.947174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 448/917] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:06.952448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c938a4-e897-48d6-8186-37494124e90d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:07.023385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49daa7-c4b6-47ad-9b68-9f8a265b71fe None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:07.063372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee596cb-b019-44e9-9bcb-fb53c9696521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:07.064819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee596cb-b019-44e9-9bcb-fb53c9696521 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:07.065615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee596cb-b019-44e9-9bcb-fb53c9696521 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:07.066142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee596cb-b019-44e9-9bcb-fb53c9696521 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:07.067113 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee596cb-b019-44e9-9bcb-fb53c9696521 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:07.067285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c938a4-e897-48d6-8186-37494124e90d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:07.067781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee596cb-b019-44e9-9bcb-fb53c9696521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:07.070322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee596cb-b019-44e9-9bcb-fb53c9696521 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:07.076748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 470/918] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:07.082902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee596cb-b019-44e9-9bcb-fb53c9696521 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:07.105905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7cc76-4f8c-423f-a460-84d9bce99604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:07.106644 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7cc76-4f8c-423f-a460-84d9bce99604 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:07.106925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7cc76-4f8c-423f-a460-84d9bce99604 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:07.107199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7cc76-4f8c-423f-a460-84d9bce99604 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:07.107996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7cc76-4f8c-423f-a460-84d9bce99604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:07.108272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7cc76-4f8c-423f-a460-84d9bce99604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:07.109738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7cc76-4f8c-423f-a460-84d9bce99604 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:07.125604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 449/919] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:07.128539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7cc76-4f8c-423f-a460-84d9bce99604 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:07.206518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee596cb-b019-44e9-9bcb-fb53c9696521 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:07.240079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c7332-8e63-492a-ac22-48786e5574fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:07.240824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c7332-8e63-492a-ac22-48786e5574fb None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:07.241022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c7332-8e63-492a-ac22-48786e5574fb None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:07.241299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c7332-8e63-492a-ac22-48786e5574fb None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:07.242040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c7332-8e63-492a-ac22-48786e5574fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:07.242347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c7332-8e63-492a-ac22-48786e5574fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:07.243729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c7332-8e63-492a-ac22-48786e5574fb None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:07.254147 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7cc76-4f8c-423f-a460-84d9bce99604 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:07.256140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 471/920] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:07.257547 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c7332-8e63-492a-ac22-48786e5574fb None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:07.289948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852f9ac-ec6a-4598-9701-c17d50707f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:07.290745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852f9ac-ec6a-4598-9701-c17d50707f6e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:07.291028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852f9ac-ec6a-4598-9701-c17d50707f6e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:07.291305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852f9ac-ec6a-4598-9701-c17d50707f6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:07.299183 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852f9ac-ec6a-4598-9701-c17d50707f6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:07.301690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852f9ac-ec6a-4598-9701-c17d50707f6e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:07.315555 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-7852f9ac-ec6a-4598-9701-c17d50707f6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:42:07.321738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 450/921] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:07.323025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852f9ac-ec6a-4598-9701-c17d50707f6e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:07.393114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c7332-8e63-492a-ac22-48786e5574fb None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:07.428870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ec26-4c6f-4634-8120-a4739a1feda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:07.429710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ec26-4c6f-4634-8120-a4739a1feda4 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:07.430114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ec26-4c6f-4634-8120-a4739a1feda4 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:07.430486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ec26-4c6f-4634-8120-a4739a1feda4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:07.431378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ec26-4c6f-4634-8120-a4739a1feda4 None admin] RBAC: Adding query filter params (interface=public, service_id=bcd7cdd49904420ba1f799f551756348, region_id=RegionOne) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:07.431789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ec26-4c6f-4634-8120-a4739a1feda4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:07.432038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852f9ac-ec6a-4598-9701-c17d50707f6e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:07.433428 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ec26-4c6f-4634-8120-a4739a1feda4 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:07.445685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 472/922] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Apr 6 12:42:07 2022] GET /identity/v3/endpoints?service_id=bcd7cdd49904420ba1f799f551756348&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:07.447047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ec26-4c6f-4634-8120-a4739a1feda4 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:07.471639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a999cc-6a05-4d97-945b-8261c095f370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:07.473018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a999cc-6a05-4d97-945b-8261c095f370 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:07.473466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a999cc-6a05-4d97-945b-8261c095f370 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:07.474212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a999cc-6a05-4d97-945b-8261c095f370 None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:07.475305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a999cc-6a05-4d97-945b-8261c095f370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:07.475771 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a999cc-6a05-4d97-945b-8261c095f370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:07.478196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a999cc-6a05-4d97-945b-8261c095f370 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:07.494105 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 451/923] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:07.501310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a999cc-6a05-4d97-945b-8261c095f370 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:07.551967 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ec26-4c6f-4634-8120-a4739a1feda4 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:07.591598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee59c2-8df6-41c5-9637-41c78e290cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:07.592260 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee59c2-8df6-41c5-9637-41c78e290cbe None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:07.592549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee59c2-8df6-41c5-9637-41c78e290cbe None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:07.592818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee59c2-8df6-41c5-9637-41c78e290cbe None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:07.593493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee59c2-8df6-41c5-9637-41c78e290cbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:07.594876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee59c2-8df6-41c5-9637-41c78e290cbe None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:07.609604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 473/924] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Apr 6 12:42:07 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:42:07.637225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a999cc-6a05-4d97-945b-8261c095f370 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:07.674967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7da1d-2f01-45d0-8472-df35c7f693c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:07.675784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7da1d-2f01-45d0-8472-df35c7f693c6 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:07.676061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7da1d-2f01-45d0-8472-df35c7f693c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:07.676333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7da1d-2f01-45d0-8472-df35c7f693c6 None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/dc8964c44ba54772b29ca1e584be8c12/roles/4900702c949549fd854b71b99b8faffb` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:07.678590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7da1d-2f01-45d0-8472-df35c7f693c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=dc8964c44ba54772b29ca1e584be8c12, role_id=4900702c949549fd854b71b99b8faffb)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:07.680205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7da1d-2f01-45d0-8472-df35c7f693c6 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:07.696806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 452/925] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:42:07 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/dc8964c44ba54772b29ca1e584be8c12/roles/4900702c949549fd854b71b99b8faffb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:42:08.617784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a1a61-5c9a-4e83-92ee-d77eca4a7d4a None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:08.618295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a1a61-5c9a-4e83-92ee-d77eca4a7d4a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:08.618518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a1a61-5c9a-4e83-92ee-d77eca4a7d4a None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:08.620312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 474/926] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:08.625706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1633a3d-3429-4124-ab4d-27256c96a247 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:08.626114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1633a3d-3429-4124-ab4d-27256c96a247 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:08.626308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1633a3d-3429-4124-ab4d-27256c96a247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:08.643874 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e1633a3d-3429-4124-ab4d-27256c96a247 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:08.645136 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e1633a3d-3429-4124-ab4d-27256c96a247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:08.710902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 453/927] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:08.735585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a1a61-5c9a-4e83-92ee-d77eca4a7d4a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:08.840117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a1a61-5c9a-4e83-92ee-d77eca4a7d4a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:08.877148 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99917250-0fc1-4aa1-833f-23eb0a359a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:08.877921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99917250-0fc1-4aa1-833f-23eb0a359a77 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:08.878208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99917250-0fc1-4aa1-833f-23eb0a359a77 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:08.878483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99917250-0fc1-4aa1-833f-23eb0a359a77 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:08.879176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99917250-0fc1-4aa1-833f-23eb0a359a77 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:08.880630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99917250-0fc1-4aa1-833f-23eb0a359a77 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:08.893045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-99917250-0fc1-4aa1-833f-23eb0a359a77 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 06 12:42:08.894649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 475/928] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:42:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:08.900517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1633a3d-3429-4124-ab4d-27256c96a247 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:08.998553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034769-0f7e-4bc1-bb31-ab763674d96d None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:08.998845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034769-0f7e-4bc1-bb31-ab763674d96d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:08.999166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034769-0f7e-4bc1-bb31-ab763674d96d None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.000696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 476/929] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:42:09.001876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1633a3d-3429-4124-ab4d-27256c96a247 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:09.005512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74acc9e-60ad-401d-b4dd-63b83b1b2244 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.005839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74acc9e-60ad-401d-b4dd-63b83b1b2244 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.006116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74acc9e-60ad-401d-b4dd-63b83b1b2244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.022762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d74acc9e-60ad-401d-b4dd-63b83b1b2244 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:09.023922 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d74acc9e-60ad-401d-b4dd-63b83b1b2244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:09.036773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c4fd2-6456-4272-a64f-ba1b68731675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:09.037434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4fd2-6456-4272-a64f-ba1b68731675 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.037803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4fd2-6456-4272-a64f-ba1b68731675 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.038082 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c4fd2-6456-4272-a64f-ba1b68731675 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.038853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c4fd2-6456-4272-a64f-ba1b68731675 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:09.039159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c4fd2-6456-4272-a64f-ba1b68731675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:09.040545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c4fd2-6456-4272-a64f-ba1b68731675 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:09.045669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 454/930] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:42:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:09.051188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c4fd2-6456-4272-a64f-ba1b68731675 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:09.113594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 477/931] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:09.131053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74acc9e-60ad-401d-b4dd-63b83b1b2244 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:09.172921 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c4fd2-6456-4272-a64f-ba1b68731675 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:09.217050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42761b68-d67c-4d5c-b41f-7c08f7307a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:09.218035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42761b68-d67c-4d5c-b41f-7c08f7307a84 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.218328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42761b68-d67c-4d5c-b41f-7c08f7307a84 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.218608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42761b68-d67c-4d5c-b41f-7c08f7307a84 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.219339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42761b68-d67c-4d5c-b41f-7c08f7307a84 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:09.219638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42761b68-d67c-4d5c-b41f-7c08f7307a84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:09.221606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42761b68-d67c-4d5c-b41f-7c08f7307a84 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:09.231810 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 455/932] 10.222.0.23 () {56 vars in 1114 bytes} [Wed Apr 6 12:42:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:09.233165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42761b68-d67c-4d5c-b41f-7c08f7307a84 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:09.243593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74acc9e-60ad-401d-b4dd-63b83b1b2244 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:09.288173 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7819-7385-4333-b768-1db042d4daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:09.289367 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7819-7385-4333-b768-1db042d4daf6 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.289860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7819-7385-4333-b768-1db042d4daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.290353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7819-7385-4333-b768-1db042d4daf6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.291223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7819-7385-4333-b768-1db042d4daf6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:09.292868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7819-7385-4333-b768-1db042d4daf6 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:09.305225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-e48b7819-7385-4333-b768-1db042d4daf6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 12:42:09.312230 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 478/933] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:09.313301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7819-7385-4333-b768-1db042d4daf6 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:09.342095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42761b68-d67c-4d5c-b41f-7c08f7307a84 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:09.376302 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dcf79-0d96-4ba7-8ce6-d4279cdeaff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:09.376963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dcf79-0d96-4ba7-8ce6-d4279cdeaff3 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.377246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dcf79-0d96-4ba7-8ce6-d4279cdeaff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.377524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dcf79-0d96-4ba7-8ce6-d4279cdeaff3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.378304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dcf79-0d96-4ba7-8ce6-d4279cdeaff3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:09.379704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dcf79-0d96-4ba7-8ce6-d4279cdeaff3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:09.413694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 456/934] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Apr 6 12:42:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:09.426529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7819-7385-4333-b768-1db042d4daf6 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:09.471355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15ed66-c2a5-4fbf-8b83-0264a0ad9ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:09.472038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ed66-c2a5-4fbf-8b83-0264a0ad9ef1 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.472317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ed66-c2a5-4fbf-8b83-0264a0ad9ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.472582 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15ed66-c2a5-4fbf-8b83-0264a0ad9ef1 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.473301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15ed66-c2a5-4fbf-8b83-0264a0ad9ef1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:09.473631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15ed66-c2a5-4fbf-8b83-0264a0ad9ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:09.475096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15ed66-c2a5-4fbf-8b83-0264a0ad9ef1 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:09.481746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 479/935] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Apr 6 12:42:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:09.487492 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dcf79-0d96-4ba7-8ce6-d4279cdeaff3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:09.598083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dcf79-0d96-4ba7-8ce6-d4279cdeaff3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:09.640765 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6cf43-6e4f-4f3b-a228-6216ceacd19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:09.641527 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6cf43-6e4f-4f3b-a228-6216ceacd19d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.641750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6cf43-6e4f-4f3b-a228-6216ceacd19d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.642018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6cf43-6e4f-4f3b-a228-6216ceacd19d None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.642729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6cf43-6e4f-4f3b-a228-6216ceacd19d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:09.643036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6cf43-6e4f-4f3b-a228-6216ceacd19d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:09.644439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6cf43-6e4f-4f3b-a228-6216ceacd19d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:09.650789 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 457/936] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Apr 6 12:42:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:09.657538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15ed66-c2a5-4fbf-8b83-0264a0ad9ef1 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:09.767586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15ed66-c2a5-4fbf-8b83-0264a0ad9ef1 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:09.804083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65eb03f-34cd-4631-bced-fa4433cd0180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:09.804742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eb03f-34cd-4631-bced-fa4433cd0180 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.805023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eb03f-34cd-4631-bced-fa4433cd0180 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.805296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65eb03f-34cd-4631-bced-fa4433cd0180 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.806116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65eb03f-34cd-4631-bced-fa4433cd0180 None admin] RBAC: Adding query filter params (interface=public, service_id=a7dadf2e98b44c1d8af1cb9c4da6368c, region_id=RegionOne) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:09.806430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65eb03f-34cd-4631-bced-fa4433cd0180 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:09.808359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65eb03f-34cd-4631-bced-fa4433cd0180 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:09.814256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 480/937] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Apr 6 12:42:09 2022] GET /identity/v3/endpoints?service_id=a7dadf2e98b44c1d8af1cb9c4da6368c&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:09.819623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6cf43-6e4f-4f3b-a228-6216ceacd19d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:09.919697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6cf43-6e4f-4f3b-a228-6216ceacd19d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:09.953350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6ad1c-bd10-45c9-bfa3-2c369953fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:09.954374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6ad1c-bd10-45c9-bfa3-2c369953fe57 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.954850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6ad1c-bd10-45c9-bfa3-2c369953fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.955316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6ad1c-bd10-45c9-bfa3-2c369953fe57 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.956201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6ad1c-bd10-45c9-bfa3-2c369953fe57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:09.957814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6ad1c-bd10-45c9-bfa3-2c369953fe57 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:09.964722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 458/938] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Apr 6 12:42:09 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:42:09.987422 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb3721-6b2c-4896-b6d7-259b2e9edbfb None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.987748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb3721-6b2c-4896-b6d7-259b2e9edbfb None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.987975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb3721-6b2c-4896-b6d7-259b2e9edbfb None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:09.989696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 481/939] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:09.995910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da07da7-130e-4329-8bf7-f1c172ec2f7d None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:09.996236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da07da7-130e-4329-8bf7-f1c172ec2f7d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:09.996463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da07da7-130e-4329-8bf7-f1c172ec2f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.014236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-8da07da7-130e-4329-8bf7-f1c172ec2f7d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:10.015426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8da07da7-130e-4329-8bf7-f1c172ec2f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:10.088425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 459/940] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:10.114230 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb3721-6b2c-4896-b6d7-259b2e9edbfb None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:10.147096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf7501-3680-4620-9ad2-2758525e2325 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:10.147439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf7501-3680-4620-9ad2-2758525e2325 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:10.147660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf7501-3680-4620-9ad2-2758525e2325 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.149298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 460/941] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:10.155231 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cc836-079a-4f15-8a19-5dde3fce35a0 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:10.155506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cc836-079a-4f15-8a19-5dde3fce35a0 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:10.155788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20cc836-079a-4f15-8a19-5dde3fce35a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.180191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b20cc836-079a-4f15-8a19-5dde3fce35a0 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:10.181611 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b20cc836-079a-4f15-8a19-5dde3fce35a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:10.234066 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb3721-6b2c-4896-b6d7-259b2e9edbfb None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:10.270185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1bc51-55d9-4d59-98bd-39f070879f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:10.270521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 461/942] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:10.271678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1bc51-55d9-4d59-98bd-39f070879f9d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:10.271968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1bc51-55d9-4d59-98bd-39f070879f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:10.272267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1bc51-55d9-4d59-98bd-39f070879f9d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.272928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1bc51-55d9-4d59-98bd-39f070879f9d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:10.277808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1bc51-55d9-4d59-98bd-39f070879f9d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:10.288286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-76e1bc51-55d9-4d59-98bd-39f070879f9d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 06 12:42:10.290135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 482/943] 10.222.0.23 () {56 vars in 1132 bytes} [Wed Apr 6 12:42:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:10.294807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cc836-079a-4f15-8a19-5dde3fce35a0 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:10.296237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1bc51-55d9-4d59-98bd-39f070879f9d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:10.403372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20cc836-079a-4f15-8a19-5dde3fce35a0 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:10.426291 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1bc51-55d9-4d59-98bd-39f070879f9d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:10.447514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f3ebd-729f-4cc9-9d5a-e22072889b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:10.449639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3ebd-729f-4cc9-9d5a-e22072889b5c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:10.450350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3ebd-729f-4cc9-9d5a-e22072889b5c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:10.450836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3ebd-729f-4cc9-9d5a-e22072889b5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.459796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812afe-e212-410a-8a69-2321fc0d0c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:10.460820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812afe-e212-410a-8a69-2321fc0d0c96 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:10.461177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812afe-e212-410a-8a69-2321fc0d0c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:10.461524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c812afe-e212-410a-8a69-2321fc0d0c96 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.462348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812afe-e212-410a-8a69-2321fc0d0c96 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:10.462724 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812afe-e212-410a-8a69-2321fc0d0c96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:10.464995 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c812afe-e212-410a-8a69-2321fc0d0c96 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:10.465479 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f3ebd-729f-4cc9-9d5a-e22072889b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:10.470256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 483/944] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:10.474637 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-199f3ebd-729f-4cc9-9d5a-e22072889b5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 12:42:10.475413 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812afe-e212-410a-8a69-2321fc0d0c96 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:10.476683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 462/945] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Apr 6 12:42:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:10.484008 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f3ebd-729f-4cc9-9d5a-e22072889b5c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:10.583736 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c812afe-e212-410a-8a69-2321fc0d0c96 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:10.584035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f3ebd-729f-4cc9-9d5a-e22072889b5c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:10.619514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5dddd-e9e3-46b6-82b4-714027fd33aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:10.620949 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5dddd-e9e3-46b6-82b4-714027fd33aa None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:10.621691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5dddd-e9e3-46b6-82b4-714027fd33aa None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:10.621691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5dddd-e9e3-46b6-82b4-714027fd33aa None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.622084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06def76b-930c-4a58-a85a-709a752c69bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:10.622493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5dddd-e9e3-46b6-82b4-714027fd33aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:10.622867 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5dddd-e9e3-46b6-82b4-714027fd33aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:10.623360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06def76b-930c-4a58-a85a-709a752c69bc None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:10.623817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06def76b-930c-4a58-a85a-709a752c69bc None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:10.624285 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06def76b-930c-4a58-a85a-709a752c69bc None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.624589 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5dddd-e9e3-46b6-82b4-714027fd33aa None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:10.625381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06def76b-930c-4a58-a85a-709a752c69bc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:10.625910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06def76b-930c-4a58-a85a-709a752c69bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:10.627526 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06def76b-930c-4a58-a85a-709a752c69bc None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:10.633742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 484/946] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:10.638490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 463/947] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Apr 6 12:42:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:10.639298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5dddd-e9e3-46b6-82b4-714027fd33aa None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:10.639837 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06def76b-930c-4a58-a85a-709a752c69bc None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:10.739623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5dddd-e9e3-46b6-82b4-714027fd33aa None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:10.746489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06def76b-930c-4a58-a85a-709a752c69bc None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:10.773071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd7171-8842-4aa1-ad13-55a9624af785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:10.774066 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd7171-8842-4aa1-ad13-55a9624af785 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:10.774530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd7171-8842-4aa1-ad13-55a9624af785 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:10.774638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd7171-8842-4aa1-ad13-55a9624af785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.784033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfa6ba-f80d-41ab-82b8-e2b461590bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:10.784993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfa6ba-f80d-41ab-82b8-e2b461590bde None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:10.785494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfa6ba-f80d-41ab-82b8-e2b461590bde None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:10.786013 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfa6ba-f80d-41ab-82b8-e2b461590bde None admin] PATH_INFO: `/v3/endpoints` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.786676 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd7171-8842-4aa1-ad13-55a9624af785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:10.787190 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfa6ba-f80d-41ab-82b8-e2b461590bde None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:10.788161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd7171-8842-4aa1-ad13-55a9624af785 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:10.789190 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfa6ba-f80d-41ab-82b8-e2b461590bde None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:10.806499 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-48dd7171-8842-4aa1-ad13-55a9624af785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:10.808838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 464/948] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:10.814340 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd7171-8842-4aa1-ad13-55a9624af785 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:10.817024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 485/949] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Apr 6 12:42:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:42:10.924212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd7171-8842-4aa1-ad13-55a9624af785 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:10.966850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d2bb2-ec34-4344-b7a9-c45b6e52132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:10.967524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d2bb2-ec34-4344-b7a9-c45b6e52132a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:10.967806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d2bb2-ec34-4344-b7a9-c45b6e52132a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:10.968080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d2bb2-ec34-4344-b7a9-c45b6e52132a None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:10.968806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d2bb2-ec34-4344-b7a9-c45b6e52132a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:10.969111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d2bb2-ec34-4344-b7a9-c45b6e52132a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:10.970554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d2bb2-ec34-4344-b7a9-c45b6e52132a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:10.984818 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 465/950] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:10.990546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfa6ba-f80d-41ab-82b8-e2b461590bde None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:11.093243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfa6ba-f80d-41ab-82b8-e2b461590bde None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:11.126765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56f516-7ff8-4540-b4c7-e55c96dcc431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:11.127575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56f516-7ff8-4540-b4c7-e55c96dcc431 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:11.127856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56f516-7ff8-4540-b4c7-e55c96dcc431 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:11.128125 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56f516-7ff8-4540-b4c7-e55c96dcc431 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:11.136167 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56f516-7ff8-4540-b4c7-e55c96dcc431 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:11.137621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56f516-7ff8-4540-b4c7-e55c96dcc431 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:11.151206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-3c56f516-7ff8-4540-b4c7-e55c96dcc431 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 06 12:42:11.152804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 486/951] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Apr 6 12:42:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:11.158204 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d2bb2-ec34-4344-b7a9-c45b6e52132a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:11.262175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d2bb2-ec34-4344-b7a9-c45b6e52132a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:11.296498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd2cd6-8953-46d1-b844-fd3e6de8d575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:11.297179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd2cd6-8953-46d1-b844-fd3e6de8d575 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:11.297461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd2cd6-8953-46d1-b844-fd3e6de8d575 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:11.297763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd2cd6-8953-46d1-b844-fd3e6de8d575 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:11.298609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd2cd6-8953-46d1-b844-fd3e6de8d575 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:11.298917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd2cd6-8953-46d1-b844-fd3e6de8d575 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:11.300643 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd2cd6-8953-46d1-b844-fd3e6de8d575 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:11.319139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 466/952] 10.222.0.23 () {56 vars in 1149 bytes} [Wed Apr 6 12:42:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:11.327734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56f516-7ff8-4540-b4c7-e55c96dcc431 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:11.428850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56f516-7ff8-4540-b4c7-e55c96dcc431 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:11.465441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e4d7c-f06d-4811-ab10-5436df0b066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:11.466143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4d7c-f06d-4811-ab10-5436df0b066b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:11.466465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4d7c-f06d-4811-ab10-5436df0b066b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:11.466747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e4d7c-f06d-4811-ab10-5436df0b066b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:11.535583 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e4d7c-f06d-4811-ab10-5436df0b066b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:11.537050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e4d7c-f06d-4811-ab10-5436df0b066b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:11.634983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 487/953] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:42:11 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:42:11.640883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd2cd6-8953-46d1-b844-fd3e6de8d575 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:11.744399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd2cd6-8953-46d1-b844-fd3e6de8d575 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:11.779400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1780c-43f3-4428-bccd-312106572ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:11.780254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1780c-43f3-4428-bccd-312106572ea3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:11.780542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1780c-43f3-4428-bccd-312106572ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:11.780821 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1780c-43f3-4428-bccd-312106572ea3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:11.791247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1780c-43f3-4428-bccd-312106572ea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:11.793394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1780c-43f3-4428-bccd-312106572ea3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:11.811029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-4fd1780c-43f3-4428-bccd-312106572ea3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:11.812571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 467/954] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:11.818147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e4d7c-f06d-4811-ab10-5436df0b066b None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:11.830106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f61a-8466-418b-a97e-25c6522dfcd4 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:11.830394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f61a-8466-418b-a97e-25c6522dfcd4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:11.830675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52f61a-8466-418b-a97e-25c6522dfcd4 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:11.832961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 468/955] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:11.837769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc40c-bda4-42a1-b025-8be493b39af3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:11.838059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc40c-bda4-42a1-b025-8be493b39af3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:11.838340 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc40c-bda4-42a1-b025-8be493b39af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:11.857374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-9aefc40c-bda4-42a1-b025-8be493b39af3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:11.858933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9aefc40c-bda4-42a1-b025-8be493b39af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:11.938405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e4d7c-f06d-4811-ab10-5436df0b066b None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:11.941708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 469/956] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:11.967043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc40c-bda4-42a1-b025-8be493b39af3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:11.985964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc840b-e3a5-4710-8982-cee23b01e60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:11.987014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc840b-e3a5-4710-8982-cee23b01e60c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:11.987524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc840b-e3a5-4710-8982-cee23b01e60c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:11.988447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc840b-e3a5-4710-8982-cee23b01e60c None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:11.989690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc840b-e3a5-4710-8982-cee23b01e60c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:11.990205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc840b-e3a5-4710-8982-cee23b01e60c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:11.992584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfc840b-e3a5-4710-8982-cee23b01e60c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:12.013364 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 488/957] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:12.014960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc840b-e3a5-4710-8982-cee23b01e60c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:12.077180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc40c-bda4-42a1-b025-8be493b39af3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:12.121029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:12.122200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:12.123101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:12.123600 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:12.125108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:12.127378 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:12.129316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.common [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 06 12:42:12.148140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfc840b-e3a5-4710-8982-cee23b01e60c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:12.153787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.sql.core [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 06 12:42:12.153787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 06 12:42:12.153787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [parameters: {'id': 'f3b4c62d31784225b5e8cfc4d585131c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 06 12:42:12.153787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86176) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 06 12:42:12.162624 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f3b4c62d31784225b5e8cfc4d585131c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f3b4c62d31784225b5e8cfc4d585131c. Apr 06 12:42:12.169984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 470/958] 10.222.0.23 () {60 vars in 1140 bytes} [Wed Apr 6 12:42:11 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:12.170972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:12.199608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ad990-af81-4028-bc55-b39b70d1f972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:12.200383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ad990-af81-4028-bc55-b39b70d1f972 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:12.200660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ad990-af81-4028-bc55-b39b70d1f972 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:12.200927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ad990-af81-4028-bc55-b39b70d1f972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:12.211209 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ad990-af81-4028-bc55-b39b70d1f972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:12.213025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ad990-af81-4028-bc55-b39b70d1f972 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:12.233265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-178ad990-af81-4028-bc55-b39b70d1f972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:42:12.235369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 489/959] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:12.241235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ad990-af81-4028-bc55-b39b70d1f972 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:12.282851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90727519-9451-41c2-b602-98ba8acd8f81 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:12.316453 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a15cd-04d5-4892-beb1-eb206c63d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:12.317152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a15cd-04d5-4892-beb1-eb206c63d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:12.317433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a15cd-04d5-4892-beb1-eb206c63d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:12.317755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a15cd-04d5-4892-beb1-eb206c63d5a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:12.325896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a15cd-04d5-4892-beb1-eb206c63d5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:12.327675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a15cd-04d5-4892-beb1-eb206c63d5a5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:12.341378 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-0a3a15cd-04d5-4892-beb1-eb206c63d5a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:42:12.347645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 471/960] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:42:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:12.348312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a15cd-04d5-4892-beb1-eb206c63d5a5 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:12.371617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ad990-af81-4028-bc55-b39b70d1f972 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:12.408526 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655e3c-49df-4004-a81e-235896d4f673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:12.409185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655e3c-49df-4004-a81e-235896d4f673 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:12.409463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655e3c-49df-4004-a81e-235896d4f673 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:12.409754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655e3c-49df-4004-a81e-235896d4f673 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:12.410533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc655e3c-49df-4004-a81e-235896d4f673 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:12.410835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc655e3c-49df-4004-a81e-235896d4f673 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:12.412264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc655e3c-49df-4004-a81e-235896d4f673 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:12.429670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 490/961] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:42:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:12.430597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655e3c-49df-4004-a81e-235896d4f673 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:12.483580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a15cd-04d5-4892-beb1-eb206c63d5a5 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:12.517510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0c2ad-8fe4-464e-a939-f256e375a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:12.518197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c2ad-8fe4-464e-a939-f256e375a5af None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:12.518478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c2ad-8fe4-464e-a939-f256e375a5af None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:12.518756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0c2ad-8fe4-464e-a939-f256e375a5af None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:12.519504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0c2ad-8fe4-464e-a939-f256e375a5af None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:12.519802 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0c2ad-8fe4-464e-a939-f256e375a5af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:12.521246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0c2ad-8fe4-464e-a939-f256e375a5af None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:12.530207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655e3c-49df-4004-a81e-235896d4f673 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:12.550241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 472/962] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:42:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:12.550241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2b80e-4b0c-40f0-8162-e4523e176769 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:12.550241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2b80e-4b0c-40f0-8162-e4523e176769 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:12.550241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2b80e-4b0c-40f0-8162-e4523e176769 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:12.550241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 473/963] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:12.552391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1629b-c7fe-4cc6-9e35-813cf584f1fd None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:12.552682 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1629b-c7fe-4cc6-9e35-813cf584f1fd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:12.552971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1629b-c7fe-4cc6-9e35-813cf584f1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:12.575390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-26c1629b-c7fe-4cc6-9e35-813cf584f1fd None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:12.575588 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4151e13-a232-4101-a7e5-1e73471456d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:12.576239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4151e13-a232-4101-a7e5-1e73471456d4 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:12.576534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4151e13-a232-4101-a7e5-1e73471456d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:12.576812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4151e13-a232-4101-a7e5-1e73471456d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:12.576927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-26c1629b-c7fe-4cc6-9e35-813cf584f1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:12.577806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4151e13-a232-4101-a7e5-1e73471456d4 None admin] RBAC: Adding query filter params (role.id=4900702c949549fd854b71b99b8faffb, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=dc8964c44ba54772b29ca1e584be8c12) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:12.578072 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4151e13-a232-4101-a7e5-1e73471456d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:12.579580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4151e13-a232-4101-a7e5-1e73471456d4 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:12.586231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 491/964] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:42:12 2022] GET /identity/v3/role_assignments?user.id=dc8964c44ba54772b29ca1e584be8c12&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=4900702c949549fd854b71b99b8faffb => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:12.656693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 474/965] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:12.683314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4151e13-a232-4101-a7e5-1e73471456d4 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:12.797995 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4151e13-a232-4101-a7e5-1e73471456d4 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:12.833553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8d881-a2fa-4876-b8e2-ec4a46519e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:12.834553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8d881-a2fa-4876-b8e2-ec4a46519e21 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:12.834837 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8d881-a2fa-4876-b8e2-ec4a46519e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:12.835110 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8d881-a2fa-4876-b8e2-ec4a46519e21 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:12.835764 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8d881-a2fa-4876-b8e2-ec4a46519e21 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:12.837132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8d881-a2fa-4876-b8e2-ec4a46519e21 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:12.849245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-8ea8d881-a2fa-4876-b8e2-ec4a46519e21 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 12:42:12.850744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 492/966] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:12.856528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1629b-c7fe-4cc6-9e35-813cf584f1fd None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:12.962307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1629b-c7fe-4cc6-9e35-813cf584f1fd None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:12.997508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f36f5f-846c-47ff-819e-5a134bf0a401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:12.998527 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f36f5f-846c-47ff-819e-5a134bf0a401 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:12.998953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f36f5f-846c-47ff-819e-5a134bf0a401 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:12.999373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f36f5f-846c-47ff-819e-5a134bf0a401 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:13.000224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f36f5f-846c-47ff-819e-5a134bf0a401 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:13.000674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f36f5f-846c-47ff-819e-5a134bf0a401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:13.002262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f36f5f-846c-47ff-819e-5a134bf0a401 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:13.007740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 475/967] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Apr 6 12:42:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:13.013627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8d881-a2fa-4876-b8e2-ec4a46519e21 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:13.113452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8d881-a2fa-4876-b8e2-ec4a46519e21 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:13.146627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd2e8f-e888-42e9-b0f7-bfc9ba69c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:13.147532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd2e8f-e888-42e9-b0f7-bfc9ba69c827 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:13.147953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd2e8f-e888-42e9-b0f7-bfc9ba69c827 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:13.148363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd2e8f-e888-42e9-b0f7-bfc9ba69c827 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:13.149195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd2e8f-e888-42e9-b0f7-bfc9ba69c827 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:13.149674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd2e8f-e888-42e9-b0f7-bfc9ba69c827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:13.151275 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd2e8f-e888-42e9-b0f7-bfc9ba69c827 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:13.156584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 493/968] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Apr 6 12:42:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:13.162232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f36f5f-846c-47ff-819e-5a134bf0a401 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:13.262742 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f36f5f-846c-47ff-819e-5a134bf0a401 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:13.296986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15216255-d212-4fa8-a90e-974b6d787144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:13.297675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15216255-d212-4fa8-a90e-974b6d787144 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:13.297962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15216255-d212-4fa8-a90e-974b6d787144 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:13.298237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15216255-d212-4fa8-a90e-974b6d787144 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:13.298979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15216255-d212-4fa8-a90e-974b6d787144 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:13.300626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15216255-d212-4fa8-a90e-974b6d787144 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:13.313938 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145363-0a25-4fb4-b06b-65b996f812b8 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:13.314264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145363-0a25-4fb4-b06b-65b996f812b8 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:13.314494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145363-0a25-4fb4-b06b-65b996f812b8 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:13.315978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 494/969] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:42:13.321203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921e4a-ee5c-472a-bed6-d374e6718cc4 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:13.321492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921e4a-ee5c-472a-bed6-d374e6718cc4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:13.321812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921e4a-ee5c-472a-bed6-d374e6718cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:13.325304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 476/970] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Apr 6 12:42:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:13.353175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2b921e4a-ee5c-472a-bed6-d374e6718cc4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:13.354607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2b921e4a-ee5c-472a-bed6-d374e6718cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:13.437462 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 495/971] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:13.459799 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15216255-d212-4fa8-a90e-974b6d787144 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:13.577391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15216255-d212-4fa8-a90e-974b6d787144 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:13.610695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216a3b7-9cea-4094-82e0-5e3a35c2231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:13.611743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a3b7-9cea-4094-82e0-5e3a35c2231c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:13.612179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a3b7-9cea-4094-82e0-5e3a35c2231c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:13.612593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216a3b7-9cea-4094-82e0-5e3a35c2231c None admin] PATH_INFO: `/v3/services/compute` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:13.613382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216a3b7-9cea-4094-82e0-5e3a35c2231c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:13.614974 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216a3b7-9cea-4094-82e0-5e3a35c2231c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:13.626356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-8216a3b7-9cea-4094-82e0-5e3a35c2231c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 06 12:42:13.627983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 477/972] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:42:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:13.635146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b921e4a-ee5c-472a-bed6-d374e6718cc4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:13.733561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b921e4a-ee5c-472a-bed6-d374e6718cc4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:13.768760 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5567d72-b191-46a0-a30b-459eafec8c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:13.769702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5567d72-b191-46a0-a30b-459eafec8c0d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:13.770146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5567d72-b191-46a0-a30b-459eafec8c0d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:13.770558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5567d72-b191-46a0-a30b-459eafec8c0d None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:13.771398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5567d72-b191-46a0-a30b-459eafec8c0d None admin] RBAC: Adding query filter params (name=compute) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:13.771946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5567d72-b191-46a0-a30b-459eafec8c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:13.773442 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5567d72-b191-46a0-a30b-459eafec8c0d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:13.779289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 496/973] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:42:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:13.784920 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216a3b7-9cea-4094-82e0-5e3a35c2231c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:13.914804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216a3b7-9cea-4094-82e0-5e3a35c2231c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:13.950067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40040519-406e-4e4b-9bf8-999ef1e05afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:13.951032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040519-406e-4e4b-9bf8-999ef1e05afa None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:13.951456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040519-406e-4e4b-9bf8-999ef1e05afa None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:13.951927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40040519-406e-4e4b-9bf8-999ef1e05afa None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:13.953199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040519-406e-4e4b-9bf8-999ef1e05afa None admin] RBAC: Adding query filter params (type=compute) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:13.953749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040519-406e-4e4b-9bf8-999ef1e05afa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:13.955288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40040519-406e-4e4b-9bf8-999ef1e05afa None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:13.960174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 478/974] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:42:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:15.027254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0959a8-b6f8-4c0b-bc05-0a75adfcc0c8 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.027864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0959a8-b6f8-4c0b-bc05-0a75adfcc0c8 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.027864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0959a8-b6f8-4c0b-bc05-0a75adfcc0c8 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.029527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 497/975] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:15.035028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e233-ff28-468b-8609-d7819c3e001b None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.035495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e233-ff28-468b-8609-d7819c3e001b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.035673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07e233-ff28-468b-8609-d7819c3e001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.041067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259fb5d-661f-4b43-99b8-2dd75761302c None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.041356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259fb5d-661f-4b43-99b8-2dd75761302c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.041731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259fb5d-661f-4b43-99b8-2dd75761302c None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.043788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 498/976] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:15.048858 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ac38-3c90-46b1-be74-fe1b768e0e59 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.049425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ac38-3c90-46b1-be74-fe1b768e0e59 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.049720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9925ac38-3c90-46b1-be74-fe1b768e0e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.053845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-fa07e233-ff28-468b-8609-d7819c3e001b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:15.055043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-fa07e233-ff28-468b-8609-d7819c3e001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:15.066802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-9925ac38-3c90-46b1-be74-fe1b768e0e59 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:15.067987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9925ac38-3c90-46b1-be74-fe1b768e0e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:15.140419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 499/977] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:15.141717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 479/978] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:15.163350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ac38-3c90-46b1-be74-fe1b768e0e59 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:15.172653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07e233-ff28-468b-8609-d7819c3e001b None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:15.268911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9925ac38-3c90-46b1-be74-fe1b768e0e59 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:15.293409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07e233-ff28-468b-8609-d7819c3e001b None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:15.303924 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959fd9b-1746-489f-85de-31d8b997a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:15.304835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959fd9b-1746-489f-85de-31d8b997a43d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.305213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959fd9b-1746-489f-85de-31d8b997a43d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.305596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959fd9b-1746-489f-85de-31d8b997a43d None admin] PATH_INFO: `/v3/services/image` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.306358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959fd9b-1746-489f-85de-31d8b997a43d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:15.308350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959fd9b-1746-489f-85de-31d8b997a43d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:15.319325 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-0959fd9b-1746-489f-85de-31d8b997a43d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 06 12:42:15.320933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 500/979] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Apr 6 12:42:15 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:15.332272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959fd9b-1746-489f-85de-31d8b997a43d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:15.342701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc911b-8b58-4a6e-9249-f44562d0e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:15.343388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc911b-8b58-4a6e-9249-f44562d0e819 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.344096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc911b-8b58-4a6e-9249-f44562d0e819 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.344096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc911b-8b58-4a6e-9249-f44562d0e819 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.344640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc911b-8b58-4a6e-9249-f44562d0e819 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:15.346293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc911b-8b58-4a6e-9249-f44562d0e819 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:15.362483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.sql.core [None req-14fc911b-8b58-4a6e-9249-f44562d0e819 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 06 12:42:15.362483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 06 12:42:15.362483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [parameters: {'user_id': 'cad50652bcf748d4a664471151f76d25', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 06 12:42:15.362483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86176) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 06 12:42:15.369349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-14fc911b-8b58-4a6e-9249-f44562d0e819 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 06 12:42:15.376434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 480/980] 10.222.0.23 () {60 vars in 1131 bytes} [Wed Apr 6 12:42:15 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:15.378249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc911b-8b58-4a6e-9249-f44562d0e819 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:15.444289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959fd9b-1746-489f-85de-31d8b997a43d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:15.480178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccf3b6-5d39-4f15-8ac8-f11be172cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:15.480729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc911b-8b58-4a6e-9249-f44562d0e819 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:15.481457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccf3b6-5d39-4f15-8ac8-f11be172cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.481980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccf3b6-5d39-4f15-8ac8-f11be172cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.482460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccf3b6-5d39-4f15-8ac8-f11be172cbc8 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.483454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccf3b6-5d39-4f15-8ac8-f11be172cbc8 None admin] RBAC: Adding query filter params (name=image) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:15.483995 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccf3b6-5d39-4f15-8ac8-f11be172cbc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:15.485607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccf3b6-5d39-4f15-8ac8-f11be172cbc8 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:15.495663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 501/981] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:15.496834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccf3b6-5d39-4f15-8ac8-f11be172cbc8 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:15.515795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f857541-c79d-4272-9db3-38aaf5083443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:15.516604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f857541-c79d-4272-9db3-38aaf5083443 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.516886 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f857541-c79d-4272-9db3-38aaf5083443 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.517160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f857541-c79d-4272-9db3-38aaf5083443 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.528831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f857541-c79d-4272-9db3-38aaf5083443 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:15.530900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f857541-c79d-4272-9db3-38aaf5083443 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:15.548559 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-6f857541-c79d-4272-9db3-38aaf5083443 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 06 12:42:15.550874 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 481/982] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:42:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:15.558179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f857541-c79d-4272-9db3-38aaf5083443 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:15.630757 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccf3b6-5d39-4f15-8ac8-f11be172cbc8 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:15.659570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f857541-c79d-4272-9db3-38aaf5083443 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:15.673290 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addf2b5-f535-4068-b1fc-2ef95fa71bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:15.674605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addf2b5-f535-4068-b1fc-2ef95fa71bd1 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.675139 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addf2b5-f535-4068-b1fc-2ef95fa71bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.675436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addf2b5-f535-4068-b1fc-2ef95fa71bd1 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.676298 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addf2b5-f535-4068-b1fc-2ef95fa71bd1 None admin] RBAC: Adding query filter params (type=image) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:15.676614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addf2b5-f535-4068-b1fc-2ef95fa71bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:15.678333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addf2b5-f535-4068-b1fc-2ef95fa71bd1 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:15.684943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 502/983] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:15.698895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90314d-d0a3-4791-853a-093f94d58fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:15.699650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90314d-d0a3-4791-853a-093f94d58fd7 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.699935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90314d-d0a3-4791-853a-093f94d58fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.700212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90314d-d0a3-4791-853a-093f94d58fd7 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.701091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90314d-d0a3-4791-853a-093f94d58fd7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:15.701404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90314d-d0a3-4791-853a-093f94d58fd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:15.703003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90314d-d0a3-4791-853a-093f94d58fd7 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:15.748640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 482/984] 10.222.0.23 () {56 vars in 1101 bytes} [Wed Apr 6 12:42:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:15.755772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308f65e-03e7-4b6c-98f9-5293c3ff4234 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.756102 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308f65e-03e7-4b6c-98f9-5293c3ff4234 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.756341 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308f65e-03e7-4b6c-98f9-5293c3ff4234 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.759617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 503/985] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:15.764872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7cf2-2c7e-45ea-8175-9942d26e949c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:15.765202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7cf2-2c7e-45ea-8175-9942d26e949c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:15.765426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da7cf2-2c7e-45ea-8175-9942d26e949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:15.787797 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e7da7cf2-2c7e-45ea-8175-9942d26e949c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:15.789966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e7da7cf2-2c7e-45ea-8175-9942d26e949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:15.873919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 483/986] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:15.894638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308f65e-03e7-4b6c-98f9-5293c3ff4234 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:16.009288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308f65e-03e7-4b6c-98f9-5293c3ff4234 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:16.045102 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d86dd-339d-4bdb-a022-ed13db9fa2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:16.046747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d86dd-339d-4bdb-a022-ed13db9fa2d5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:16.047282 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d86dd-339d-4bdb-a022-ed13db9fa2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:16.047767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d86dd-339d-4bdb-a022-ed13db9fa2d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:16.048634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d86dd-339d-4bdb-a022-ed13db9fa2d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:16.050546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d86dd-339d-4bdb-a022-ed13db9fa2d5 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:16.063626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-6f9d86dd-339d-4bdb-a022-ed13db9fa2d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 12:42:16.069659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 504/987] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:16.071693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da7cf2-2c7e-45ea-8175-9942d26e949c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:16.169541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da7cf2-2c7e-45ea-8175-9942d26e949c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:16.204043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a23152-0074-4b1a-a132-42ae086f8393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:16.204710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a23152-0074-4b1a-a132-42ae086f8393 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:16.204995 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a23152-0074-4b1a-a132-42ae086f8393 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:16.205270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a23152-0074-4b1a-a132-42ae086f8393 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:16.206001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a23152-0074-4b1a-a132-42ae086f8393 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:16.206310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a23152-0074-4b1a-a132-42ae086f8393 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:16.207712 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a23152-0074-4b1a-a132-42ae086f8393 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:16.217083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 484/988] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Apr 6 12:42:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:16.218312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d86dd-339d-4bdb-a022-ed13db9fa2d5 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:16.322213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d86dd-339d-4bdb-a022-ed13db9fa2d5 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:16.362076 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5241f-1669-4948-9c46-9168cebaf9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:16.362737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5241f-1669-4948-9c46-9168cebaf9e8 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:16.363015 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5241f-1669-4948-9c46-9168cebaf9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:16.363283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5241f-1669-4948-9c46-9168cebaf9e8 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:16.363981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5241f-1669-4948-9c46-9168cebaf9e8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:16.364281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5241f-1669-4948-9c46-9168cebaf9e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:16.365687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5241f-1669-4948-9c46-9168cebaf9e8 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:16.371184 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 505/989] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Apr 6 12:42:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:16.376012 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee4483-51cc-4c5a-8b15-ec12dfdb8086 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:16.376306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee4483-51cc-4c5a-8b15-ec12dfdb8086 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:16.376405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5241f-1669-4948-9c46-9168cebaf9e8 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:16.376575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee4483-51cc-4c5a-8b15-ec12dfdb8086 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:16.378106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 485/990] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:16.382678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34146fb-8588-481d-8fc3-a6f814d38fa9 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:16.382960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34146fb-8588-481d-8fc3-a6f814d38fa9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:16.383233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34146fb-8588-481d-8fc3-a6f814d38fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:16.400093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b34146fb-8588-481d-8fc3-a6f814d38fa9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:16.401295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b34146fb-8588-481d-8fc3-a6f814d38fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:16.469708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 486/991] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:16.480686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5241f-1669-4948-9c46-9168cebaf9e8 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:16.500222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34146fb-8588-481d-8fc3-a6f814d38fa9 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:16.513240 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c74e18-44c8-45c6-98c2-097e97549004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:16.513932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c74e18-44c8-45c6-98c2-097e97549004 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:16.514215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c74e18-44c8-45c6-98c2-097e97549004 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:16.514491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c74e18-44c8-45c6-98c2-097e97549004 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:16.515288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c74e18-44c8-45c6-98c2-097e97549004 None admin] RBAC: Adding query filter params (interface=admin, service_id=a7dadf2e98b44c1d8af1cb9c4da6368c, region_id=RegionOne) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:16.515602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c74e18-44c8-45c6-98c2-097e97549004 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:16.516970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c74e18-44c8-45c6-98c2-097e97549004 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:16.521988 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 506/992] 10.222.0.23 () {56 vars in 1249 bytes} [Wed Apr 6 12:42:16 2022] GET /identity/v3/endpoints?service_id=a7dadf2e98b44c1d8af1cb9c4da6368c&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:16.527966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c74e18-44c8-45c6-98c2-097e97549004 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:16.611063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34146fb-8588-481d-8fc3-a6f814d38fa9 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:16.634590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c74e18-44c8-45c6-98c2-097e97549004 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:16.647221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e71b18-d321-4150-b52e-f358df04ec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:16.647990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71b18-d321-4150-b52e-f358df04ec43 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:16.648341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71b18-d321-4150-b52e-f358df04ec43 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:16.648677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e71b18-d321-4150-b52e-f358df04ec43 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:16.649454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e71b18-d321-4150-b52e-f358df04ec43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:16.650945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e71b18-d321-4150-b52e-f358df04ec43 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:16.677616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 487/993] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:42:16 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:16.681346 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628d162-e9f6-4dc5-b17b-bdf7aa1df7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:16.682059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d162-e9f6-4dc5-b17b-bdf7aa1df7be None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:16.682939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d162-e9f6-4dc5-b17b-bdf7aa1df7be None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:16.683365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628d162-e9f6-4dc5-b17b-bdf7aa1df7be None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:16.686059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628d162-e9f6-4dc5-b17b-bdf7aa1df7be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:16.686059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628d162-e9f6-4dc5-b17b-bdf7aa1df7be None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:16.692280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 507/994] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Apr 6 12:42:16 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:42:18.068192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe1465-5f3a-45d8-a5cc-a5bc68d0f4f9 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:18.068885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe1465-5f3a-45d8-a5cc-a5bc68d0f4f9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:18.068885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe1465-5f3a-45d8-a5cc-a5bc68d0f4f9 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:18.070249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 488/995] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:18.075374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c1dc8-1e64-45bc-b3cd-7058ffff023d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:18.075762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c1dc8-1e64-45bc-b3cd-7058ffff023d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:18.075968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c1dc8-1e64-45bc-b3cd-7058ffff023d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:18.092893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-9e9c1dc8-1e64-45bc-b3cd-7058ffff023d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:18.094126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9e9c1dc8-1e64-45bc-b3cd-7058ffff023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:18.159195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 508/996] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:18.183838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe1465-5f3a-45d8-a5cc-a5bc68d0f4f9 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:18.284389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe1465-5f3a-45d8-a5cc-a5bc68d0f4f9 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:18.319145 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63e724-37f2-4e67-9ed2-da06230ad752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:18.319696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63e724-37f2-4e67-9ed2-da06230ad752 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:18.320023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63e724-37f2-4e67-9ed2-da06230ad752 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:18.320278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63e724-37f2-4e67-9ed2-da06230ad752 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:18.320988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63e724-37f2-4e67-9ed2-da06230ad752 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:18.322407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63e724-37f2-4e67-9ed2-da06230ad752 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:18.343070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 489/997] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:42:18 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:19.030800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d5f6-115c-4aa8-b0b7-aa8ecfcaf22d None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.031071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d5f6-115c-4aa8-b0b7-aa8ecfcaf22d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.031513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d5f6-115c-4aa8-b0b7-aa8ecfcaf22d None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.033018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 509/998] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:19.038620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bbffe-9b3f-436d-b803-c0f18b476ada None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.039169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bbffe-9b3f-436d-b803-c0f18b476ada None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.039657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0bbffe-9b3f-436d-b803-c0f18b476ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.056271 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-5c0bbffe-9b3f-436d-b803-c0f18b476ada None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:19.058479 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-5c0bbffe-9b3f-436d-b803-c0f18b476ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:19.069136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abd2d7-f806-416d-8b19-1a9d11b22812 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.069439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abd2d7-f806-416d-8b19-1a9d11b22812 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.069840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abd2d7-f806-416d-8b19-1a9d11b22812 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.071393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 510/999] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:42:19.077387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dcc33-0e13-4e71-af85-8eef4bc5ad65 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.078126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dcc33-0e13-4e71-af85-8eef4bc5ad65 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.078126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dcc33-0e13-4e71-af85-8eef4bc5ad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.095403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-a85dcc33-0e13-4e71-af85-8eef4bc5ad65 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:19.096650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a85dcc33-0e13-4e71-af85-8eef4bc5ad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:19.132459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 490/1000] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:19 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:19.156807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bbffe-9b3f-436d-b803-c0f18b476ada None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:19.163578 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 511/1001] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:19 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:19.188457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dcc33-0e13-4e71-af85-8eef4bc5ad65 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:19.255029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0bbffe-9b3f-436d-b803-c0f18b476ada None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:19.289969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dcc33-0e13-4e71-af85-8eef4bc5ad65 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:19.290180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e718e75-7d49-46cc-8a64-b42a40a03ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:19.290841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718e75-7d49-46cc-8a64-b42a40a03ee6 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.291120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718e75-7d49-46cc-8a64-b42a40a03ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.291389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e718e75-7d49-46cc-8a64-b42a40a03ee6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.292091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e718e75-7d49-46cc-8a64-b42a40a03ee6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:19.293486 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e718e75-7d49-46cc-8a64-b42a40a03ee6 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:19.304830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-7e718e75-7d49-46cc-8a64-b42a40a03ee6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 06 12:42:19.306202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 491/1002] 10.222.0.23 () {56 vars in 1126 bytes} [Wed Apr 6 12:42:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:19.311855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e718e75-7d49-46cc-8a64-b42a40a03ee6 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:19.331857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506cfa6-b656-477d-b8c2-5ee3e8804500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:19.332803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cfa6-b656-477d-b8c2-5ee3e8804500 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.333090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cfa6-b656-477d-b8c2-5ee3e8804500 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.333377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506cfa6-b656-477d-b8c2-5ee3e8804500 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.334314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506cfa6-b656-477d-b8c2-5ee3e8804500 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:19.335424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506cfa6-b656-477d-b8c2-5ee3e8804500 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:19.347134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-a506cfa6-b656-477d-b8c2-5ee3e8804500 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 06 12:42:19.348494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 512/1003] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:42:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:19.354053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506cfa6-b656-477d-b8c2-5ee3e8804500 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:19.414145 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e718e75-7d49-46cc-8a64-b42a40a03ee6 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:19.447648 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d7032-cf11-4911-aa9b-9669cac2673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:19.449392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d7032-cf11-4911-aa9b-9669cac2673e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.449724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d7032-cf11-4911-aa9b-9669cac2673e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.450009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d7032-cf11-4911-aa9b-9669cac2673e None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.450741 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d7032-cf11-4911-aa9b-9669cac2673e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:19.451056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d7032-cf11-4911-aa9b-9669cac2673e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:19.452462 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d7032-cf11-4911-aa9b-9669cac2673e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:19.454091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506cfa6-b656-477d-b8c2-5ee3e8804500 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:19.463315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 492/1004] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Apr 6 12:42:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:19.469084 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d7032-cf11-4911-aa9b-9669cac2673e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:19.502191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3a9ff-668b-49d2-ba9b-0d5aba65b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:19.502856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3a9ff-668b-49d2-ba9b-0d5aba65b043 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.503139 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3a9ff-668b-49d2-ba9b-0d5aba65b043 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.503420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3a9ff-668b-49d2-ba9b-0d5aba65b043 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.504130 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3a9ff-668b-49d2-ba9b-0d5aba65b043 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:19.504437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3a9ff-668b-49d2-ba9b-0d5aba65b043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:19.505850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3a9ff-668b-49d2-ba9b-0d5aba65b043 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:19.513624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 513/1005] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:42:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:19.517315 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3a9ff-668b-49d2-ba9b-0d5aba65b043 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:19.575622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d7032-cf11-4911-aa9b-9669cac2673e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:19.609546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c61877-5fb2-47b6-b7be-6975905176c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:19.610227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c61877-5fb2-47b6-b7be-6975905176c2 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.610506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c61877-5fb2-47b6-b7be-6975905176c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.610778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c61877-5fb2-47b6-b7be-6975905176c2 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.611474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c61877-5fb2-47b6-b7be-6975905176c2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:19.611769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c61877-5fb2-47b6-b7be-6975905176c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:19.612767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3a9ff-668b-49d2-ba9b-0d5aba65b043 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:19.613307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c61877-5fb2-47b6-b7be-6975905176c2 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:19.623226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 493/1006] 10.222.0.23 () {56 vars in 1122 bytes} [Wed Apr 6 12:42:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:19.624723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c61877-5fb2-47b6-b7be-6975905176c2 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:19.646480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134a212-beeb-4243-9ffc-1b67bb3ca498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:19.647136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134a212-beeb-4243-9ffc-1b67bb3ca498 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.647415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134a212-beeb-4243-9ffc-1b67bb3ca498 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.647687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134a212-beeb-4243-9ffc-1b67bb3ca498 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.648386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134a212-beeb-4243-9ffc-1b67bb3ca498 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:19.648690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134a212-beeb-4243-9ffc-1b67bb3ca498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:19.650090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134a212-beeb-4243-9ffc-1b67bb3ca498 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:19.656020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 514/1007] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:42:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:19.663772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134a212-beeb-4243-9ffc-1b67bb3ca498 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:19.733738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c61877-5fb2-47b6-b7be-6975905176c2 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:19.762703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134a212-beeb-4243-9ffc-1b67bb3ca498 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:19.765036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3174a-f68f-4ff2-853f-e15d120a5d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:19.765717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3174a-f68f-4ff2-853f-e15d120a5d65 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.765999 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3174a-f68f-4ff2-853f-e15d120a5d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.766274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3174a-f68f-4ff2-853f-e15d120a5d65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.767004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3174a-f68f-4ff2-853f-e15d120a5d65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:19.768409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3174a-f68f-4ff2-853f-e15d120a5d65 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:19.783135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 494/1008] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Apr 6 12:42:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:19.803656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12196613-2ca3-4e11-9e3e-3afc51e1dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:19.804334 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196613-2ca3-4e11-9e3e-3afc51e1dd1e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.804614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196613-2ca3-4e11-9e3e-3afc51e1dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.804887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196613-2ca3-4e11-9e3e-3afc51e1dd1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.805783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12196613-2ca3-4e11-9e3e-3afc51e1dd1e None admin] RBAC: Adding query filter params (interface=public, service_id=0b1a5c028f394133a199c48c14df5247, region_id=RegionOne) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:19.806097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12196613-2ca3-4e11-9e3e-3afc51e1dd1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:19.807896 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12196613-2ca3-4e11-9e3e-3afc51e1dd1e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:19.813908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 515/1009] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Apr 6 12:42:19 2022] GET /identity/v3/endpoints?service_id=0b1a5c028f394133a199c48c14df5247&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:19.825813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3174a-f68f-4ff2-853f-e15d120a5d65 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:19.934494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3174a-f68f-4ff2-853f-e15d120a5d65 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:19.970047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09b2fb-b2db-4b7c-bc75-5c8169e97a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:19.970716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09b2fb-b2db-4b7c-bc75-5c8169e97a92 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:19.970994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09b2fb-b2db-4b7c-bc75-5c8169e97a92 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:19.971268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09b2fb-b2db-4b7c-bc75-5c8169e97a92 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:19.971965 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09b2fb-b2db-4b7c-bc75-5c8169e97a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:19.973345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09b2fb-b2db-4b7c-bc75-5c8169e97a92 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:19.980398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 495/1010] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Apr 6 12:42:19 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:42:20.700431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2b7a9-1a8a-4a88-9be7-6dd83a2af8f5 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:20.700928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2b7a9-1a8a-4a88-9be7-6dd83a2af8f5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:20.700928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2b7a9-1a8a-4a88-9be7-6dd83a2af8f5 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:20.702296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 516/1011] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:20.707701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315a5b-95bb-41ba-85f7-fe2ff135d56e None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:20.708136 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315a5b-95bb-41ba-85f7-fe2ff135d56e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:20.708313 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32315a5b-95bb-41ba-85f7-fe2ff135d56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:20.724816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-32315a5b-95bb-41ba-85f7-fe2ff135d56e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:20.726042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-32315a5b-95bb-41ba-85f7-fe2ff135d56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:20.790141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 496/1012] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:20 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:20.814835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2b7a9-1a8a-4a88-9be7-6dd83a2af8f5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:20.930934 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2b7a9-1a8a-4a88-9be7-6dd83a2af8f5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:20.967894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45963f40-1a2f-479e-8d1d-08d47bd66fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:20.968613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45963f40-1a2f-479e-8d1d-08d47bd66fb9 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:20.968899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45963f40-1a2f-479e-8d1d-08d47bd66fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:20.969174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45963f40-1a2f-479e-8d1d-08d47bd66fb9 None admin] PATH_INFO: `/v3/services/image` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:20.969851 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45963f40-1a2f-479e-8d1d-08d47bd66fb9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:20.971222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45963f40-1a2f-479e-8d1d-08d47bd66fb9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:20.983414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-45963f40-1a2f-479e-8d1d-08d47bd66fb9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 06 12:42:20.984806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 517/1013] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Apr 6 12:42:20 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:20.990524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32315a5b-95bb-41ba-85f7-fe2ff135d56e None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:21.103281 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32315a5b-95bb-41ba-85f7-fe2ff135d56e None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:21.138907 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adbd3c-7bfd-44bf-95c6-3d427f5e0e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:21.139568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adbd3c-7bfd-44bf-95c6-3d427f5e0e96 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:21.139852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adbd3c-7bfd-44bf-95c6-3d427f5e0e96 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:21.140121 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adbd3c-7bfd-44bf-95c6-3d427f5e0e96 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:21.140815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adbd3c-7bfd-44bf-95c6-3d427f5e0e96 None admin] RBAC: Adding query filter params (name=image) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:21.141114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adbd3c-7bfd-44bf-95c6-3d427f5e0e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:21.142525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adbd3c-7bfd-44bf-95c6-3d427f5e0e96 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:21.152352 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 497/1014] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:21.153930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45963f40-1a2f-479e-8d1d-08d47bd66fb9 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:21.250087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45963f40-1a2f-479e-8d1d-08d47bd66fb9 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:21.283933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d367d-fe5f-48ed-910a-43cb073e913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:21.284594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d367d-fe5f-48ed-910a-43cb073e913f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:21.284865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d367d-fe5f-48ed-910a-43cb073e913f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:21.285207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d367d-fe5f-48ed-910a-43cb073e913f None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:21.285873 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d367d-fe5f-48ed-910a-43cb073e913f None admin] RBAC: Adding query filter params (type=image) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:21.286178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d367d-fe5f-48ed-910a-43cb073e913f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:21.287555 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d367d-fe5f-48ed-910a-43cb073e913f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:21.293022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 518/1015] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:21.298893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adbd3c-7bfd-44bf-95c6-3d427f5e0e96 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:21.396575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adbd3c-7bfd-44bf-95c6-3d427f5e0e96 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:21.429363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78abd98-e8f1-4c55-a273-0be994dabbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:21.430068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78abd98-e8f1-4c55-a273-0be994dabbdb None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:21.430353 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78abd98-e8f1-4c55-a273-0be994dabbdb None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:21.430629 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78abd98-e8f1-4c55-a273-0be994dabbdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:21.431415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78abd98-e8f1-4c55-a273-0be994dabbdb None admin] RBAC: Adding query filter params (interface=public, service_id=01570830c8e24b97b6608e8c928787f9, region_id=RegionOne) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:21.431776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78abd98-e8f1-4c55-a273-0be994dabbdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:21.433318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78abd98-e8f1-4c55-a273-0be994dabbdb None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:21.442953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 498/1016] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Apr 6 12:42:21 2022] GET /identity/v3/endpoints?service_id=01570830c8e24b97b6608e8c928787f9&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:21.444214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d367d-fe5f-48ed-910a-43cb073e913f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:21.548443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d367d-fe5f-48ed-910a-43cb073e913f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:21.581443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b6720-66ad-4379-b1a2-3fbefbe893ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:21.582152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6720-66ad-4379-b1a2-3fbefbe893ae None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:21.582438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6720-66ad-4379-b1a2-3fbefbe893ae None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:21.582722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b6720-66ad-4379-b1a2-3fbefbe893ae None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:21.583401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b6720-66ad-4379-b1a2-3fbefbe893ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:21.584774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b6720-66ad-4379-b1a2-3fbefbe893ae None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:21.597605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 519/1017] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Apr 6 12:42:21 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:42:22.136481 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e245a37-b995-4d5d-807c-9a45f14d7353 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:22.137004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e245a37-b995-4d5d-807c-9a45f14d7353 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:22.137085 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e245a37-b995-4d5d-807c-9a45f14d7353 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:22.138565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 499/1018] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:22.143655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eebbc-7b73-4db2-b2dd-d1884d0f6954 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:22.144055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eebbc-7b73-4db2-b2dd-d1884d0f6954 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:22.144213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eebbc-7b73-4db2-b2dd-d1884d0f6954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:22.160882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-862eebbc-7b73-4db2-b2dd-d1884d0f6954 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:22.162086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-862eebbc-7b73-4db2-b2dd-d1884d0f6954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:22.227267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 520/1019] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:22 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:22.254295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e245a37-b995-4d5d-807c-9a45f14d7353 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:22.300307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa13c-3751-4d05-984e-d925657ec6f7 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:22.300666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa13c-3751-4d05-984e-d925657ec6f7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:22.300895 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfa13c-3751-4d05-984e-d925657ec6f7 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:22.302402 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 521/1020] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:42:22.307579 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce0ee-b6c0-4bec-9e61-a61bd5dfab40 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:22.307871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce0ee-b6c0-4bec-9e61-a61bd5dfab40 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:22.308153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ce0ee-b6c0-4bec-9e61-a61bd5dfab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:22.328548 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b75ce0ee-b6c0-4bec-9e61-a61bd5dfab40 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:22.329772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b75ce0ee-b6c0-4bec-9e61-a61bd5dfab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:22.378685 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e245a37-b995-4d5d-807c-9a45f14d7353 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:22.408778 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 522/1021] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:22 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:22.420531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186acb6-9ed9-4f14-913c-c07e40941430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:22.421336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186acb6-9ed9-4f14-913c-c07e40941430 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:22.421878 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186acb6-9ed9-4f14-913c-c07e40941430 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:22.422021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186acb6-9ed9-4f14-913c-c07e40941430 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:22.423116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186acb6-9ed9-4f14-913c-c07e40941430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:22.424841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186acb6-9ed9-4f14-913c-c07e40941430 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:22.431208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 500/1022] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:22.433929 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ce0ee-b6c0-4bec-9e61-a61bd5dfab40 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:22.451213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186acb6-9ed9-4f14-913c-c07e40941430 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:22.565203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186acb6-9ed9-4f14-913c-c07e40941430 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:22.565542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ce0ee-b6c0-4bec-9e61-a61bd5dfab40 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:22.606169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7f11c-ed81-4a9e-b8ea-746287ecb798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:22.606778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7f11c-ed81-4a9e-b8ea-746287ecb798 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:22.607106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7f11c-ed81-4a9e-b8ea-746287ecb798 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:22.607377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7f11c-ed81-4a9e-b8ea-746287ecb798 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:22.608009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7f11c-ed81-4a9e-b8ea-746287ecb798 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:22.609425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7f11c-ed81-4a9e-b8ea-746287ecb798 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:22.612155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494139c-4c26-4885-b43e-347459964b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:22.612820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494139c-4c26-4885-b43e-347459964b6c None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:22.613095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494139c-4c26-4885-b43e-347459964b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:22.613384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494139c-4c26-4885-b43e-347459964b6c None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:22.614115 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494139c-4c26-4885-b43e-347459964b6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:22.615534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494139c-4c26-4885-b43e-347459964b6c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:22.626972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-99e7f11c-ed81-4a9e-b8ea-746287ecb798 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 06 12:42:22.633633 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 501/1023] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:42:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:22.636439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7f11c-ed81-4a9e-b8ea-746287ecb798 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:22.653616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 523/1024] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:42:22 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:22.764691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7f11c-ed81-4a9e-b8ea-746287ecb798 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:22.804822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e5e7-dad0-43ee-bba6-d776bbc454d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:22.805864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e5e7-dad0-43ee-bba6-d776bbc454d3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:22.806369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e5e7-dad0-43ee-bba6-d776bbc454d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:22.806857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339e5e7-dad0-43ee-bba6-d776bbc454d3 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:22.808770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e5e7-dad0-43ee-bba6-d776bbc454d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:22.809363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e5e7-dad0-43ee-bba6-d776bbc454d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:22.811031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339e5e7-dad0-43ee-bba6-d776bbc454d3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:22.821966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 502/1025] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:42:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:22.823663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494139c-4c26-4885-b43e-347459964b6c None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:22.942450 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494139c-4c26-4885-b43e-347459964b6c None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:22.995357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664cb6e-b6c8-4f02-8d6f-376f886e84bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:22.996447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664cb6e-b6c8-4f02-8d6f-376f886e84bf None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:22.996929 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664cb6e-b6c8-4f02-8d6f-376f886e84bf None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:22.997400 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664cb6e-b6c8-4f02-8d6f-376f886e84bf None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:22.998769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664cb6e-b6c8-4f02-8d6f-376f886e84bf None admin] RBAC: Adding query filter params (type=compute) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:22.999302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664cb6e-b6c8-4f02-8d6f-376f886e84bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:23.001753 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664cb6e-b6c8-4f02-8d6f-376f886e84bf None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:23.014781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 524/1026] 10.222.0.23 () {56 vars in 1112 bytes} [Wed Apr 6 12:42:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:23.016868 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e5e7-dad0-43ee-bba6-d776bbc454d3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:23.175036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339e5e7-dad0-43ee-bba6-d776bbc454d3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:23.230086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde0bb7-cc6a-4490-a85e-f1446898b7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:23.231032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde0bb7-cc6a-4490-a85e-f1446898b7a4 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:23.231513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde0bb7-cc6a-4490-a85e-f1446898b7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:23.231996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde0bb7-cc6a-4490-a85e-f1446898b7a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:23.233349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde0bb7-cc6a-4490-a85e-f1446898b7a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:23.235939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde0bb7-cc6a-4490-a85e-f1446898b7a4 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:23.268543 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 503/1027] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Apr 6 12:42:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:42:24.161653 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4ce85-3dae-4e23-af89-e8db6411469c None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:24.162186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4ce85-3dae-4e23-af89-e8db6411469c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:24.162186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4ce85-3dae-4e23-af89-e8db6411469c None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:24.163584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 525/1028] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:24.169292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cee05-1c47-45b3-a760-b2e7614a50ec None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:24.169601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cee05-1c47-45b3-a760-b2e7614a50ec None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:24.169890 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cee05-1c47-45b3-a760-b2e7614a50ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:24.186451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-6a1cee05-1c47-45b3-a760-b2e7614a50ec None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:24.187626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6a1cee05-1c47-45b3-a760-b2e7614a50ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:24.257632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 504/1029] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:24.282179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4ce85-3dae-4e23-af89-e8db6411469c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:24.381150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4ce85-3dae-4e23-af89-e8db6411469c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:24.412623 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b946428-c1a8-41ac-8e8a-d017adbccc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:24.413324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b946428-c1a8-41ac-8e8a-d017adbccc71 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:24.413619 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b946428-c1a8-41ac-8e8a-d017adbccc71 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:24.413892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b946428-c1a8-41ac-8e8a-d017adbccc71 None admin] PATH_INFO: `/v3/services/image` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:24.414530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b946428-c1a8-41ac-8e8a-d017adbccc71 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:24.415879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b946428-c1a8-41ac-8e8a-d017adbccc71 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:24.427237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-0b946428-c1a8-41ac-8e8a-d017adbccc71 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 06 12:42:24.428576 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 526/1030] 10.222.0.23 () {56 vars in 1105 bytes} [Wed Apr 6 12:42:24 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:24.435019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cee05-1c47-45b3-a760-b2e7614a50ec None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:24.530170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cee05-1c47-45b3-a760-b2e7614a50ec None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:24.564102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a700-1242-406e-8fc3-55b7e19641c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:24.564764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a700-1242-406e-8fc3-55b7e19641c3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:24.565040 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a700-1242-406e-8fc3-55b7e19641c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:24.565310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a700-1242-406e-8fc3-55b7e19641c3 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:24.566058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0a700-1242-406e-8fc3-55b7e19641c3 None admin] RBAC: Adding query filter params (name=image) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:24.566362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0a700-1242-406e-8fc3-55b7e19641c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:24.567745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0a700-1242-406e-8fc3-55b7e19641c3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:24.577017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 505/1031] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:24.578306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b946428-c1a8-41ac-8e8a-d017adbccc71 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:24.674849 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b946428-c1a8-41ac-8e8a-d017adbccc71 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:24.709593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f4dd4-a351-4d59-8018-3a71ec6154b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:24.710278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4dd4-a351-4d59-8018-3a71ec6154b0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:24.710560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4dd4-a351-4d59-8018-3a71ec6154b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:24.710833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f4dd4-a351-4d59-8018-3a71ec6154b0 None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:24.711546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f4dd4-a351-4d59-8018-3a71ec6154b0 None admin] RBAC: Adding query filter params (type=image) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:24.711855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f4dd4-a351-4d59-8018-3a71ec6154b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:24.713813 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f4dd4-a351-4d59-8018-3a71ec6154b0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:24.719267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 527/1032] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:24.724683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a700-1242-406e-8fc3-55b7e19641c3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:24.820673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a700-1242-406e-8fc3-55b7e19641c3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:24.853647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6053f3-948d-4f24-80f6-91b8eb4975f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:24.854397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6053f3-948d-4f24-80f6-91b8eb4975f1 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:24.854673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6053f3-948d-4f24-80f6-91b8eb4975f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:24.854946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6053f3-948d-4f24-80f6-91b8eb4975f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:24.855689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6053f3-948d-4f24-80f6-91b8eb4975f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:24.857096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6053f3-948d-4f24-80f6-91b8eb4975f1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:24.881607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 506/1033] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Apr 6 12:42:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:25.074479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750b071-1040-4b39-a684-688d0208e0d1 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:25.074765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750b071-1040-4b39-a684-688d0208e0d1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:25.075047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750b071-1040-4b39-a684-688d0208e0d1 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:25.076411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 528/1034] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:25.081744 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce20917-d0ce-4e18-be12-6ebb717cfe92 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:25.082036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce20917-d0ce-4e18-be12-6ebb717cfe92 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:25.082313 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce20917-d0ce-4e18-be12-6ebb717cfe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:25.099595 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-0ce20917-d0ce-4e18-be12-6ebb717cfe92 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:25.100755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0ce20917-d0ce-4e18-be12-6ebb717cfe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:25.173031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 507/1035] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:25.199060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750b071-1040-4b39-a684-688d0208e0d1 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:25.298269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750b071-1040-4b39-a684-688d0208e0d1 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:25.333667 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe261f8-84d6-485c-933d-4689ac52837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:25.334463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe261f8-84d6-485c-933d-4689ac52837d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:25.334747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe261f8-84d6-485c-933d-4689ac52837d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:25.335024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe261f8-84d6-485c-933d-4689ac52837d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:25.336206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe261f8-84d6-485c-933d-4689ac52837d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:25.337681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe261f8-84d6-485c-933d-4689ac52837d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:25.344515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 529/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:25.345456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce20917-d0ce-4e18-be12-6ebb717cfe92 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:25.447087 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce20917-d0ce-4e18-be12-6ebb717cfe92 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:25.480419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd4f1a-a695-4a86-bd4a-bea29535873a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:25.481494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd4f1a-a695-4a86-bd4a-bea29535873a None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:25.481944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd4f1a-a695-4a86-bd4a-bea29535873a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:25.482381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd4f1a-a695-4a86-bd4a-bea29535873a None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:25.483372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd4f1a-a695-4a86-bd4a-bea29535873a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:25.485049 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd4f1a-a695-4a86-bd4a-bea29535873a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:25.504746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 508/1037] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:42:25 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:42:25.842828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327b558-7762-4f29-805f-92f8450f2139 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:25.843163 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327b558-7762-4f29-805f-92f8450f2139 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:25.843438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327b558-7762-4f29-805f-92f8450f2139 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:25.845012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 530/1038] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:25.850113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8ca8-f206-41b1-bed8-4973d4e35e22 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:25.850488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8ca8-f206-41b1-bed8-4973d4e35e22 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:25.850837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8ca8-f206-41b1-bed8-4973d4e35e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:25.867002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-91aa8ca8-f206-41b1-bed8-4973d4e35e22 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:25.868166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-91aa8ca8-f206-41b1-bed8-4973d4e35e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:25.933614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 509/1039] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:25.957347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327b558-7762-4f29-805f-92f8450f2139 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:26.060276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327b558-7762-4f29-805f-92f8450f2139 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:26.093959 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3bc99-c660-41b1-b3dd-d61bdca314c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:26.094692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3bc99-c660-41b1-b3dd-d61bdca314c2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:26.094974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3bc99-c660-41b1-b3dd-d61bdca314c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:26.095248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3bc99-c660-41b1-b3dd-d61bdca314c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:26.105527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3bc99-c660-41b1-b3dd-d61bdca314c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:26.112772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-55d3bc99-c660-41b1-b3dd-d61bdca314c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 12:42:26.114154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 531/1040] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Apr 6 12:42:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:26.120249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa8ca8-f206-41b1-bed8-4973d4e35e22 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:26.215030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa8ca8-f206-41b1-bed8-4973d4e35e22 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:26.247902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5d4f5-fd27-41bf-8cf7-b2017df100ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:26.248573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5d4f5-fd27-41bf-8cf7-b2017df100ef None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:26.248856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5d4f5-fd27-41bf-8cf7-b2017df100ef None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:26.249133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5d4f5-fd27-41bf-8cf7-b2017df100ef None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:26.249906 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5d4f5-fd27-41bf-8cf7-b2017df100ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:26.250214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5d4f5-fd27-41bf-8cf7-b2017df100ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:26.251616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5d4f5-fd27-41bf-8cf7-b2017df100ef None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:26.259681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 510/1041] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Apr 6 12:42:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:26.265341 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3bc99-c660-41b1-b3dd-d61bdca314c2 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:26.366902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3bc99-c660-41b1-b3dd-d61bdca314c2 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:26.400351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8e810-ac0d-407c-95db-4076ff4489bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:26.401874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e810-ac0d-407c-95db-4076ff4489bd None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:26.401987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e810-ac0d-407c-95db-4076ff4489bd None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:26.402204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8e810-ac0d-407c-95db-4076ff4489bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:26.412027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8e810-ac0d-407c-95db-4076ff4489bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:26.413464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8e810-ac0d-407c-95db-4076ff4489bd None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:26.430609 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-26a8e810-ac0d-407c-95db-4076ff4489bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:26.436397 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 532/1042] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:26.438234 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5d4f5-fd27-41bf-8cf7-b2017df100ef None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:26.536620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5d4f5-fd27-41bf-8cf7-b2017df100ef None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:26.571386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05109922-931e-47e9-885c-a25f4b547132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:26.572055 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05109922-931e-47e9-885c-a25f4b547132 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:26.572331 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05109922-931e-47e9-885c-a25f4b547132 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:26.573711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05109922-931e-47e9-885c-a25f4b547132 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:26.574426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05109922-931e-47e9-885c-a25f4b547132 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:26.574742 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05109922-931e-47e9-885c-a25f4b547132 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:26.576132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05109922-931e-47e9-885c-a25f4b547132 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:26.588013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 511/1043] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:26.594154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8e810-ac0d-407c-95db-4076ff4489bd None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:26.694651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8e810-ac0d-407c-95db-4076ff4489bd None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:26.730217 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344bf55-ed99-437a-9446-90ea009e19cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:26.731015 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344bf55-ed99-437a-9446-90ea009e19cd None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:26.731299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344bf55-ed99-437a-9446-90ea009e19cd None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:26.731573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344bf55-ed99-437a-9446-90ea009e19cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:26.739156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344bf55-ed99-437a-9446-90ea009e19cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:26.740594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344bf55-ed99-437a-9446-90ea009e19cd None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:26.754103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-c344bf55-ed99-437a-9446-90ea009e19cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 12:42:26.755441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 533/1044] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Apr 6 12:42:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:26.761842 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05109922-931e-47e9-885c-a25f4b547132 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:26.864965 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05109922-931e-47e9-885c-a25f4b547132 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:26.899011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0297-dd9e-48eb-965f-61b301d2e53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:26.899691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0297-dd9e-48eb-965f-61b301d2e53a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:26.899974 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0297-dd9e-48eb-965f-61b301d2e53a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:26.900251 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0297-dd9e-48eb-965f-61b301d2e53a None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:26.901747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0297-dd9e-48eb-965f-61b301d2e53a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:26.902110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0297-dd9e-48eb-965f-61b301d2e53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:26.903699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0297-dd9e-48eb-965f-61b301d2e53a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:26.926104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 512/1045] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Apr 6 12:42:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:26.927653 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344bf55-ed99-437a-9446-90ea009e19cd None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:27.023652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344bf55-ed99-437a-9446-90ea009e19cd None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:27.055429 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2701936-6628-42f1-9f50-d73e775da686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:27.056072 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701936-6628-42f1-9f50-d73e775da686 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:27.056351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701936-6628-42f1-9f50-d73e775da686 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:27.056619 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2701936-6628-42f1-9f50-d73e775da686 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:27.122054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2701936-6628-42f1-9f50-d73e775da686 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:27.123581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2701936-6628-42f1-9f50-d73e775da686 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:27.222773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 534/1046] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:42:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:42:27.228668 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0297-dd9e-48eb-965f-61b301d2e53a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:27.232815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8301f6-867d-4d84-954f-3c2e41c42456 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:27.233100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8301f6-867d-4d84-954f-3c2e41c42456 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:27.233374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8301f6-867d-4d84-954f-3c2e41c42456 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:27.234862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 535/1047] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:42:27.239683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8accd41-4d1e-4600-8e58-aa5f6de7cd7f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:27.239967 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8accd41-4d1e-4600-8e58-aa5f6de7cd7f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:27.240241 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8accd41-4d1e-4600-8e58-aa5f6de7cd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:27.257301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-c8accd41-4d1e-4600-8e58-aa5f6de7cd7f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:27.258508 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c8accd41-4d1e-4600-8e58-aa5f6de7cd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:27.329156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 536/1048] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:27.342692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0297-dd9e-48eb-965f-61b301d2e53a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:27.350921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8accd41-4d1e-4600-8e58-aa5f6de7cd7f None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:27.377095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89836a-3b20-408a-9692-db1345a286e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:27.377921 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89836a-3b20-408a-9692-db1345a286e6 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:27.378202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89836a-3b20-408a-9692-db1345a286e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:27.378469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89836a-3b20-408a-9692-db1345a286e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:27.388215 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89836a-3b20-408a-9692-db1345a286e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:27.389724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89836a-3b20-408a-9692-db1345a286e6 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:27.405984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-6c89836a-3b20-408a-9692-db1345a286e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:27.411997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 513/1049] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:27.412995 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89836a-3b20-408a-9692-db1345a286e6 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:27.459202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8accd41-4d1e-4600-8e58-aa5f6de7cd7f None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:27.508979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174f2d2-35d3-4d2c-8da8-1457581d709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:27.509941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174f2d2-35d3-4d2c-8da8-1457581d709f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:27.510314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174f2d2-35d3-4d2c-8da8-1457581d709f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:27.510689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174f2d2-35d3-4d2c-8da8-1457581d709f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:27.528877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89836a-3b20-408a-9692-db1345a286e6 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:27.574698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad4919-f532-4889-8e3f-872df4717d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:27.575360 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad4919-f532-4889-8e3f-872df4717d2d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:27.575714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad4919-f532-4889-8e3f-872df4717d2d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:27.576157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad4919-f532-4889-8e3f-872df4717d2d None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:27.576876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad4919-f532-4889-8e3f-872df4717d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:27.577180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad4919-f532-4889-8e3f-872df4717d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:27.578609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad4919-f532-4889-8e3f-872df4717d2d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:27.598714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174f2d2-35d3-4d2c-8da8-1457581d709f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:27.600008 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 514/1050] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:27.600134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174f2d2-35d3-4d2c-8da8-1457581d709f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:27.601451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad4919-f532-4889-8e3f-872df4717d2d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:27.698859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 537/1051] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:42:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 06 12:42:27.708112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174f2d2-35d3-4d2c-8da8-1457581d709f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:27.726197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad4919-f532-4889-8e3f-872df4717d2d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:27.763010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cba35-2f78-44ea-84f9-c5b872818aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:27.763819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cba35-2f78-44ea-84f9-c5b872818aaa None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:27.764098 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cba35-2f78-44ea-84f9-c5b872818aaa None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:27.764374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cba35-2f78-44ea-84f9-c5b872818aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:27.772712 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cba35-2f78-44ea-84f9-c5b872818aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:27.774826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cba35-2f78-44ea-84f9-c5b872818aaa None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:27.793305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-808cba35-2f78-44ea-84f9-c5b872818aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:42:27.799607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 515/1052] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:27.800963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cba35-2f78-44ea-84f9-c5b872818aaa None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:27.813145 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174f2d2-35d3-4d2c-8da8-1457581d709f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:27.845830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4fa73-ea85-45dd-af1d-3d07ccc82044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:27.846615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4fa73-ea85-45dd-af1d-3d07ccc82044 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:27.846894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4fa73-ea85-45dd-af1d-3d07ccc82044 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:27.847158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4fa73-ea85-45dd-af1d-3d07ccc82044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:27.857646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4fa73-ea85-45dd-af1d-3d07ccc82044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:27.859070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4fa73-ea85-45dd-af1d-3d07ccc82044 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:27.876350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-bdf4fa73-ea85-45dd-af1d-3d07ccc82044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:27.877610 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 538/1053] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:27.883433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4fa73-ea85-45dd-af1d-3d07ccc82044 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:27.899426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cba35-2f78-44ea-84f9-c5b872818aaa None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:27.934291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4abd7-d9f5-4447-ab52-6bd9d5ba03f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:27.934944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4abd7-d9f5-4447-ab52-6bd9d5ba03f0 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:27.935222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4abd7-d9f5-4447-ab52-6bd9d5ba03f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:27.935488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4abd7-d9f5-4447-ab52-6bd9d5ba03f0 None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:27.936269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4abd7-d9f5-4447-ab52-6bd9d5ba03f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:27.936572 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4abd7-d9f5-4447-ab52-6bd9d5ba03f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:27.938074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4abd7-d9f5-4447-ab52-6bd9d5ba03f0 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:27.949721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 516/1054] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:27.950968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6273-8a5b-44d3-a0aa-abdf7cca26d6 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:27.951264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6273-8a5b-44d3-a0aa-abdf7cca26d6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:27.951545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e6273-8a5b-44d3-a0aa-abdf7cca26d6 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:27.952940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 517/1055] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:27.955400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e6273-8a5b-44d3-a0aa-abdf7cca26d6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:27.980386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4fa73-ea85-45dd-af1d-3d07ccc82044 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:28.011672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9834b26-85f6-41ff-8b71-94c9101a5bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:28.012320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9834b26-85f6-41ff-8b71-94c9101a5bf4 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:28.012598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9834b26-85f6-41ff-8b71-94c9101a5bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:28.012866 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9834b26-85f6-41ff-8b71-94c9101a5bf4 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:28.013593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9834b26-85f6-41ff-8b71-94c9101a5bf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:28.013903 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9834b26-85f6-41ff-8b71-94c9101a5bf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:28.015256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9834b26-85f6-41ff-8b71-94c9101a5bf4 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:28.026308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 539/1056] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:28.027580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f431e9c-877e-4a3e-a03f-7eef49c821eb None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:28.027870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f431e9c-877e-4a3e-a03f-7eef49c821eb None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:28.028142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f431e9c-877e-4a3e-a03f-7eef49c821eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:28.054218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-0f431e9c-877e-4a3e-a03f-7eef49c821eb None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:28.055435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0f431e9c-877e-4a3e-a03f-7eef49c821eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:28.056309 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e6273-8a5b-44d3-a0aa-abdf7cca26d6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:28.091914 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52decca5-ac5d-4d20-8395-60486d83d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:28.092594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52decca5-ac5d-4d20-8395-60486d83d534 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:28.092909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52decca5-ac5d-4d20-8395-60486d83d534 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:28.093188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52decca5-ac5d-4d20-8395-60486d83d534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:28.094090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52decca5-ac5d-4d20-8395-60486d83d534 None admin] RBAC: Adding query filter params (role.id=4900702c949549fd854b71b99b8faffb, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=65b295446c7741ea96caf60ac955d82d) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:28.094404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52decca5-ac5d-4d20-8395-60486d83d534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:28.095926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52decca5-ac5d-4d20-8395-60486d83d534 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:28.101894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 518/1057] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:42:27 2022] GET /identity/v3/role_assignments?user.id=65b295446c7741ea96caf60ac955d82d&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=4900702c949549fd854b71b99b8faffb => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:28.130833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 540/1058] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:28.156989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52decca5-ac5d-4d20-8395-60486d83d534 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:28.267498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52decca5-ac5d-4d20-8395-60486d83d534 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:28.306156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a233b-8fca-4a0f-8479-65af64c0783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:28.307112 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a233b-8fca-4a0f-8479-65af64c0783a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:28.307399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a233b-8fca-4a0f-8479-65af64c0783a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:28.307672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a233b-8fca-4a0f-8479-65af64c0783a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:28.318111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a233b-8fca-4a0f-8479-65af64c0783a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:28.325625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-265a233b-8fca-4a0f-8479-65af64c0783a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:42:28.329044 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 519/1059] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:28.335200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f431e9c-877e-4a3e-a03f-7eef49c821eb None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:28.432755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f431e9c-877e-4a3e-a03f-7eef49c821eb None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:28.465321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fef949-0fa0-42be-aba0-2ddc89fb8c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:28.466027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fef949-0fa0-42be-aba0-2ddc89fb8c38 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:28.466307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fef949-0fa0-42be-aba0-2ddc89fb8c38 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:28.466577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fef949-0fa0-42be-aba0-2ddc89fb8c38 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:28.467316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fef949-0fa0-42be-aba0-2ddc89fb8c38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:28.467625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fef949-0fa0-42be-aba0-2ddc89fb8c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:28.468983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fef949-0fa0-42be-aba0-2ddc89fb8c38 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:28.476816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 541/1060] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:28.482735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a233b-8fca-4a0f-8479-65af64c0783a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:28.576940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a233b-8fca-4a0f-8479-65af64c0783a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:28.609164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43385-9f53-488a-9060-12e2b6a6413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:28.610053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43385-9f53-488a-9060-12e2b6a6413f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:28.610334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43385-9f53-488a-9060-12e2b6a6413f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:28.610605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e43385-9f53-488a-9060-12e2b6a6413f None admin] PATH_INFO: `/v3/users/5f2e1d0eb5964af9aa4c1e99321ed32b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:28.623282 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e43385-9f53-488a-9060-12e2b6a6413f None admin] RBAC: Authorizing `identity:get_user(user_id=5f2e1d0eb5964af9aa4c1e99321ed32b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:28.624735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e43385-9f53-488a-9060-12e2b6a6413f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:28.626383 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 520/1061] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:42:28 2022] GET /identity/v3/users/5f2e1d0eb5964af9aa4c1e99321ed32b => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:28.632045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fef949-0fa0-42be-aba0-2ddc89fb8c38 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:28.725353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fef949-0fa0-42be-aba0-2ddc89fb8c38 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:28.756738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675fb3d-4877-40ea-91fe-ebeb790e7e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:28.757381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675fb3d-4877-40ea-91fe-ebeb790e7e6a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:28.757704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675fb3d-4877-40ea-91fe-ebeb790e7e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:28.757983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675fb3d-4877-40ea-91fe-ebeb790e7e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:28.821935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675fb3d-4877-40ea-91fe-ebeb790e7e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:28.823565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675fb3d-4877-40ea-91fe-ebeb790e7e6a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:28.914971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 542/1062] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:42:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:42:28.921217 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43385-9f53-488a-9060-12e2b6a6413f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:29.013508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e43385-9f53-488a-9060-12e2b6a6413f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:29.045791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d24d7-9f57-477e-b0c6-3221cb7c4bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:29.046636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d24d7-9f57-477e-b0c6-3221cb7c4bed None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:29.046915 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d24d7-9f57-477e-b0c6-3221cb7c4bed None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:29.047184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d24d7-9f57-477e-b0c6-3221cb7c4bed None admin] PATH_INFO: `/v3/projects/1235585fe70242f4a02f9013a3f6bcba` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:29.048334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d24d7-9f57-477e-b0c6-3221cb7c4bed None admin] RBAC: Authorizing `identity:get_project(project_id=1235585fe70242f4a02f9013a3f6bcba)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:29.050090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d24d7-9f57-477e-b0c6-3221cb7c4bed None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:29.051766 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 521/1063] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:42:28 2022] GET /identity/v3/projects/1235585fe70242f4a02f9013a3f6bcba => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:29.058173 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675fb3d-4877-40ea-91fe-ebeb790e7e6a None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:29.156136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675fb3d-4877-40ea-91fe-ebeb790e7e6a None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:29.189786 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b408d-dfc3-4d14-8bc6-ae552fc2a3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:29.190443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b408d-dfc3-4d14-8bc6-ae552fc2a3de None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:29.190727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b408d-dfc3-4d14-8bc6-ae552fc2a3de None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:29.191002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b408d-dfc3-4d14-8bc6-ae552fc2a3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:29.191828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b408d-dfc3-4d14-8bc6-ae552fc2a3de None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=1235585fe70242f4a02f9013a3f6bcba, user.id=5f2e1d0eb5964af9aa4c1e99321ed32b) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:29.192140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b408d-dfc3-4d14-8bc6-ae552fc2a3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:29.193600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b408d-dfc3-4d14-8bc6-ae552fc2a3de None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:29.199939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 543/1064] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:42:29 2022] GET /identity/v3/role_assignments?user.id=5f2e1d0eb5964af9aa4c1e99321ed32b&scope.project.id=1235585fe70242f4a02f9013a3f6bcba&role.id=c158bb1781c44a03890992161076b84b => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:30.427609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8731b-ab93-407c-b542-a8c4b094f423 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:30.428139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8731b-ab93-407c-b542-a8c4b094f423 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:30.428139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8731b-ab93-407c-b542-a8c4b094f423 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:30.429498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 522/1065] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:30.435116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b187-735c-4aad-8565-ee401fae274f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:30.435530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b187-735c-4aad-8565-ee401fae274f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:30.435671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2b187-735c-4aad-8565-ee401fae274f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:30.452719 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-cdf2b187-735c-4aad-8565-ee401fae274f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:30.453931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cdf2b187-735c-4aad-8565-ee401fae274f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:30.517131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 544/1066] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:30.540276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8731b-ab93-407c-b542-a8c4b094f423 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:30.640442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8731b-ab93-407c-b542-a8c4b094f423 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:30.673338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb402-e3dd-4ef7-8a5c-ac62648b7d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:30.674421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb402-e3dd-4ef7-8a5c-ac62648b7d4a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:30.674699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb402-e3dd-4ef7-8a5c-ac62648b7d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:30.674972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beb402-e3dd-4ef7-8a5c-ac62648b7d4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:30.685322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70beb402-e3dd-4ef7-8a5c-ac62648b7d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:30.692832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-70beb402-e3dd-4ef7-8a5c-ac62648b7d4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 12:42:30.694039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 523/1067] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Apr 6 12:42:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:30.702124 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b187-735c-4aad-8565-ee401fae274f None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:30.794378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2b187-735c-4aad-8565-ee401fae274f None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:30.826831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7800aa3-2bcd-4fc1-89dc-c2ea871e4edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:30.827492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7800aa3-2bcd-4fc1-89dc-c2ea871e4edf None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:30.827773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7800aa3-2bcd-4fc1-89dc-c2ea871e4edf None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:30.828046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7800aa3-2bcd-4fc1-89dc-c2ea871e4edf None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:30.828782 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7800aa3-2bcd-4fc1-89dc-c2ea871e4edf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:30.829087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7800aa3-2bcd-4fc1-89dc-c2ea871e4edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:30.830489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7800aa3-2bcd-4fc1-89dc-c2ea871e4edf None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:30.838170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 545/1068] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Apr 6 12:42:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:30.843961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb402-e3dd-4ef7-8a5c-ac62648b7d4a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:30.937998 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beb402-e3dd-4ef7-8a5c-ac62648b7d4a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:30.969641 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f2bd1-abaa-4594-94da-cec0d23f7377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:30.970428 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2bd1-abaa-4594-94da-cec0d23f7377 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:30.970708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2bd1-abaa-4594-94da-cec0d23f7377 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:30.970981 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2bd1-abaa-4594-94da-cec0d23f7377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:30.982276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f2bd1-abaa-4594-94da-cec0d23f7377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:30.983760 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f2bd1-abaa-4594-94da-cec0d23f7377 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:31.000056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-ee7f2bd1-abaa-4594-94da-cec0d23f7377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:31.001253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 524/1069] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:31.007477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7800aa3-2bcd-4fc1-89dc-c2ea871e4edf None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:31.122773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7800aa3-2bcd-4fc1-89dc-c2ea871e4edf None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:31.158754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a3a73-c98f-4511-90bd-985034c88581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:31.159436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a3a73-c98f-4511-90bd-985034c88581 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:31.159718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a3a73-c98f-4511-90bd-985034c88581 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:31.159991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a3a73-c98f-4511-90bd-985034c88581 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:31.160716 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a3a73-c98f-4511-90bd-985034c88581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:31.161022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a3a73-c98f-4511-90bd-985034c88581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:31.162453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a3a73-c98f-4511-90bd-985034c88581 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:31.177081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 546/1070] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:31.183586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f2bd1-abaa-4594-94da-cec0d23f7377 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:31.308700 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f2bd1-abaa-4594-94da-cec0d23f7377 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:31.367494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c450b-b433-4ae9-843a-550dfab5d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:31.368808 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c450b-b433-4ae9-843a-550dfab5d00a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:31.369698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c450b-b433-4ae9-843a-550dfab5d00a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:31.370100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c450b-b433-4ae9-843a-550dfab5d00a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:31.386929 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c450b-b433-4ae9-843a-550dfab5d00a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:31.390080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c450b-b433-4ae9-843a-550dfab5d00a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:31.411230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-c70c450b-b433-4ae9-843a-550dfab5d00a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 12:42:31.412835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 525/1071] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Apr 6 12:42:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:31.419775 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a3a73-c98f-4511-90bd-985034c88581 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:31.524868 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be3023-e415-41ba-b0be-8ee03818a711 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:31.526097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be3023-e415-41ba-b0be-8ee03818a711 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:31.526097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be3023-e415-41ba-b0be-8ee03818a711 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:31.527542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 526/1072] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:42:31.533916 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a48e12-0a2d-4ed4-9b5b-388132c5d3b9 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:31.534276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a48e12-0a2d-4ed4-9b5b-388132c5d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:31.534622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a48e12-0a2d-4ed4-9b5b-388132c5d3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:31.544947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a3a73-c98f-4511-90bd-985034c88581 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:31.552124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-59a48e12-0a2d-4ed4-9b5b-388132c5d3b9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:31.553308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-59a48e12-0a2d-4ed4-9b5b-388132c5d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:31.587640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af414f-218c-4045-81e6-7c6f63b4b858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:31.589004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af414f-218c-4045-81e6-7c6f63b4b858 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:31.589400 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af414f-218c-4045-81e6-7c6f63b4b858 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:31.589728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af414f-218c-4045-81e6-7c6f63b4b858 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:31.590811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af414f-218c-4045-81e6-7c6f63b4b858 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:31.591278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af414f-218c-4045-81e6-7c6f63b4b858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:31.593204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af414f-218c-4045-81e6-7c6f63b4b858 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:31.610992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 547/1073] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Apr 6 12:42:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:31.616475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af414f-218c-4045-81e6-7c6f63b4b858 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:31.616853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 527/1074] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:31.639402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a48e12-0a2d-4ed4-9b5b-388132c5d3b9 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:31.724904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af414f-218c-4045-81e6-7c6f63b4b858 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:31.731905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a48e12-0a2d-4ed4-9b5b-388132c5d3b9 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:31.763475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e5522-37d2-47ac-838e-f089bff5509a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:31.764245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e5522-37d2-47ac-838e-f089bff5509a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:31.764530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e5522-37d2-47ac-838e-f089bff5509a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:31.764805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e5522-37d2-47ac-838e-f089bff5509a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:31.766924 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951392-68dd-490a-8852-4859727a3d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:31.767892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951392-68dd-490a-8852-4859727a3d39 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:31.768200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951392-68dd-490a-8852-4859727a3d39 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:31.768544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951392-68dd-490a-8852-4859727a3d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:31.774441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e5522-37d2-47ac-838e-f089bff5509a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:31.781986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36951392-68dd-490a-8852-4859727a3d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:31.782123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-e52e5522-37d2-47ac-838e-f089bff5509a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:42:31.783247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 528/1075] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:31.783960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36951392-68dd-490a-8852-4859727a3d39 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:31.790441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e5522-37d2-47ac-838e-f089bff5509a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:31.806107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-36951392-68dd-490a-8852-4859727a3d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:31.807437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 548/1076] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:31.812885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951392-68dd-490a-8852-4859727a3d39 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:31.888909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e5522-37d2-47ac-838e-f089bff5509a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:31.907459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951392-68dd-490a-8852-4859727a3d39 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:31.920392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68350cc4-deb1-48a4-aa24-9aef98a84bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:31.921050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68350cc4-deb1-48a4-aa24-9aef98a84bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:31.921325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68350cc4-deb1-48a4-aa24-9aef98a84bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:31.921630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68350cc4-deb1-48a4-aa24-9aef98a84bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:31.922365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68350cc4-deb1-48a4-aa24-9aef98a84bc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:31.922665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68350cc4-deb1-48a4-aa24-9aef98a84bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:31.924307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68350cc4-deb1-48a4-aa24-9aef98a84bc2 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:31.931895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 529/1077] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:31.937500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68350cc4-deb1-48a4-aa24-9aef98a84bc2 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:31.939467 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513b9b9-1a05-46a0-8074-af26085332c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:31.940128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513b9b9-1a05-46a0-8074-af26085332c6 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:31.940410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513b9b9-1a05-46a0-8074-af26085332c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:31.940687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513b9b9-1a05-46a0-8074-af26085332c6 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:31.941408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513b9b9-1a05-46a0-8074-af26085332c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:31.941745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513b9b9-1a05-46a0-8074-af26085332c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:31.943104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513b9b9-1a05-46a0-8074-af26085332c6 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:31.958706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 549/1078] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:31.959867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513b9b9-1a05-46a0-8074-af26085332c6 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:32.035306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68350cc4-deb1-48a4-aa24-9aef98a84bc2 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:32.053135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513b9b9-1a05-46a0-8074-af26085332c6 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:32.068254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e60d8-4e92-4642-af72-df2597ebf4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:32.069126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e60d8-4e92-4642-af72-df2597ebf4e7 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:32.069406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e60d8-4e92-4642-af72-df2597ebf4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:32.069707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e60d8-4e92-4642-af72-df2597ebf4e7 None admin] PATH_INFO: `/v3/users/5f2e1d0eb5964af9aa4c1e99321ed32b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:32.070919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e60d8-4e92-4642-af72-df2597ebf4e7 None admin] RBAC: Authorizing `identity:get_user(user_id=5f2e1d0eb5964af9aa4c1e99321ed32b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:32.072472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e60d8-4e92-4642-af72-df2597ebf4e7 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:32.074156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 530/1079] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:42:31 2022] GET /identity/v3/users/5f2e1d0eb5964af9aa4c1e99321ed32b => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:32.079627 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e60d8-4e92-4642-af72-df2597ebf4e7 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:32.085621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810766e0-e491-4961-803d-8fa8537c69fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:32.086416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810766e0-e491-4961-803d-8fa8537c69fb None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:32.086701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810766e0-e491-4961-803d-8fa8537c69fb None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:32.086981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810766e0-e491-4961-803d-8fa8537c69fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:32.094040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810766e0-e491-4961-803d-8fa8537c69fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:32.095481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810766e0-e491-4961-803d-8fa8537c69fb None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:32.109328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-810766e0-e491-4961-803d-8fa8537c69fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:42:32.110534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 550/1080] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:32.116187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810766e0-e491-4961-803d-8fa8537c69fb None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:32.177350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e60d8-4e92-4642-af72-df2597ebf4e7 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:32.209861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55950d-99b6-4d97-905a-ad6f1c851fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:32.210716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55950d-99b6-4d97-905a-ad6f1c851fd2 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:32.210991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55950d-99b6-4d97-905a-ad6f1c851fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:32.211258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55950d-99b6-4d97-905a-ad6f1c851fd2 None admin] PATH_INFO: `/v3/projects/1235585fe70242f4a02f9013a3f6bcba` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:32.212419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55950d-99b6-4d97-905a-ad6f1c851fd2 None admin] RBAC: Authorizing `identity:get_project(project_id=1235585fe70242f4a02f9013a3f6bcba)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:32.212616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810766e0-e491-4961-803d-8fa8537c69fb None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:32.214701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55950d-99b6-4d97-905a-ad6f1c851fd2 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:32.216414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 531/1081] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:42:32 2022] GET /identity/v3/projects/1235585fe70242f4a02f9013a3f6bcba => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:32.222162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55950d-99b6-4d97-905a-ad6f1c851fd2 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:32.247935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31a2c6-7b87-4d88-a6b1-0f6e78ba3805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:32.248595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31a2c6-7b87-4d88-a6b1-0f6e78ba3805 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:32.248877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31a2c6-7b87-4d88-a6b1-0f6e78ba3805 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:32.249146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31a2c6-7b87-4d88-a6b1-0f6e78ba3805 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:32.249957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31a2c6-7b87-4d88-a6b1-0f6e78ba3805 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:32.250260 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31a2c6-7b87-4d88-a6b1-0f6e78ba3805 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:32.251687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31a2c6-7b87-4d88-a6b1-0f6e78ba3805 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:32.263435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 551/1082] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:32.269054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31a2c6-7b87-4d88-a6b1-0f6e78ba3805 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:32.318847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55950d-99b6-4d97-905a-ad6f1c851fd2 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:32.352178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a26fc-a22a-4606-b45d-61632e7c0732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:32.353058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a26fc-a22a-4606-b45d-61632e7c0732 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:32.353432 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a26fc-a22a-4606-b45d-61632e7c0732 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:32.355295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a26fc-a22a-4606-b45d-61632e7c0732 None admin] PATH_INFO: `/v3/projects/1235585fe70242f4a02f9013a3f6bcba/users/5f2e1d0eb5964af9aa4c1e99321ed32b/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:32.356135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a26fc-a22a-4606-b45d-61632e7c0732 None admin] RBAC: Authorizing `identity:create_grant(project_id=1235585fe70242f4a02f9013a3f6bcba, user_id=5f2e1d0eb5964af9aa4c1e99321ed32b, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:32.357619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a26fc-a22a-4606-b45d-61632e7c0732 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:32.366066 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31a2c6-7b87-4d88-a6b1-0f6e78ba3805 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:32.369651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 532/1083] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:42:32 2022] PUT /identity/v3/projects/1235585fe70242f4a02f9013a3f6bcba/users/5f2e1d0eb5964af9aa4c1e99321ed32b/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:42:32.401098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09327aa8-f416-4a95-b8b7-2caf1e5f71ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:32.402039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327aa8-f416-4a95-b8b7-2caf1e5f71ae None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:32.402322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327aa8-f416-4a95-b8b7-2caf1e5f71ae None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:32.402598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09327aa8-f416-4a95-b8b7-2caf1e5f71ae None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/65b295446c7741ea96caf60ac955d82d/roles/4900702c949549fd854b71b99b8faffb` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:32.404897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327aa8-f416-4a95-b8b7-2caf1e5f71ae None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=65b295446c7741ea96caf60ac955d82d, role_id=4900702c949549fd854b71b99b8faffb)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:32.406421 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09327aa8-f416-4a95-b8b7-2caf1e5f71ae None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:32.420660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 552/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:42:32 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/65b295446c7741ea96caf60ac955d82d/roles/4900702c949549fd854b71b99b8faffb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:42:34.691533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a82f9-e2f5-4589-9fe3-b260cef01523 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:34.692039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a82f9-e2f5-4589-9fe3-b260cef01523 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:34.692039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a82f9-e2f5-4589-9fe3-b260cef01523 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:34.693361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 533/1085] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:34.699043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee44718-d831-47a6-bb81-8f270a6d08b2 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:34.699485 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee44718-d831-47a6-bb81-8f270a6d08b2 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:34.699594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee44718-d831-47a6-bb81-8f270a6d08b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:34.716729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-cee44718-d831-47a6-bb81-8f270a6d08b2 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:34.717957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cee44718-d831-47a6-bb81-8f270a6d08b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:34.774859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb421-d3d9-42fd-9034-9e2500e70521 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:34.775212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb421-d3d9-42fd-9034-9e2500e70521 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:34.775489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb421-d3d9-42fd-9034-9e2500e70521 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:34.777187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 534/1086] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:42:34.782085 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21270453-3124-4f23-8026-a15d478a1622 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:34.782373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21270453-3124-4f23-8026-a15d478a1622 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:34.782762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21270453-3124-4f23-8026-a15d478a1622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:34.783573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 553/1087] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:34.799226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-21270453-3124-4f23-8026-a15d478a1622 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:34.800418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-21270453-3124-4f23-8026-a15d478a1622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:34.809244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee44718-d831-47a6-bb81-8f270a6d08b2 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:34.865715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 535/1088] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:42:34.891105 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21270453-3124-4f23-8026-a15d478a1622 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:34.902293 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee44718-d831-47a6-bb81-8f270a6d08b2 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:34.935045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129430cd-9a64-42bb-a7d1-d68c81e3f0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:34.935830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129430cd-9a64-42bb-a7d1-d68c81e3f0b7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:34.936110 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129430cd-9a64-42bb-a7d1-d68c81e3f0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:34.936377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129430cd-9a64-42bb-a7d1-d68c81e3f0b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:34.946981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129430cd-9a64-42bb-a7d1-d68c81e3f0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:34.953953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-129430cd-9a64-42bb-a7d1-d68c81e3f0b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:42:34.955171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 554/1089] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:34.961027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129430cd-9a64-42bb-a7d1-d68c81e3f0b7 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:34.986411 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21270453-3124-4f23-8026-a15d478a1622 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.018699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e1096-316b-45d2-85f5-6c04cab81408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.019501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1096-316b-45d2-85f5-6c04cab81408 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.019781 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1096-316b-45d2-85f5-6c04cab81408 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.020053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e1096-316b-45d2-85f5-6c04cab81408 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.029982 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e1096-316b-45d2-85f5-6c04cab81408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:35.037333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-fe1e1096-316b-45d2-85f5-6c04cab81408 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 06 12:42:35.038582 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 536/1090] 10.222.0.23 () {56 vars in 1120 bytes} [Wed Apr 6 12:42:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:35.044866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e1096-316b-45d2-85f5-6c04cab81408 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:35.055969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129430cd-9a64-42bb-a7d1-d68c81e3f0b7 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.088877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f7387-1bb6-4d4e-9b4c-2ba14f1a0113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.089814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f7387-1bb6-4d4e-9b4c-2ba14f1a0113 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.090093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f7387-1bb6-4d4e-9b4c-2ba14f1a0113 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.090365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f7387-1bb6-4d4e-9b4c-2ba14f1a0113 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.091105 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f7387-1bb6-4d4e-9b4c-2ba14f1a0113 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:35.091410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f7387-1bb6-4d4e-9b4c-2ba14f1a0113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:35.092797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f7387-1bb6-4d4e-9b4c-2ba14f1a0113 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:35.100490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 555/1091] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:35.106183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f7387-1bb6-4d4e-9b4c-2ba14f1a0113 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:35.138757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e1096-316b-45d2-85f5-6c04cab81408 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.169968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64741f89-814b-4a98-87f7-a97c21a6aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.170616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64741f89-814b-4a98-87f7-a97c21a6aca4 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.170923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64741f89-814b-4a98-87f7-a97c21a6aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.171197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64741f89-814b-4a98-87f7-a97c21a6aca4 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.171932 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64741f89-814b-4a98-87f7-a97c21a6aca4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:35.172235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64741f89-814b-4a98-87f7-a97c21a6aca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:35.173634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64741f89-814b-4a98-87f7-a97c21a6aca4 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:35.182129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 537/1092] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Apr 6 12:42:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:35.187501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64741f89-814b-4a98-87f7-a97c21a6aca4 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:35.199823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f7387-1bb6-4d4e-9b4c-2ba14f1a0113 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.231044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6e132-2b13-414f-a24c-e68b903fc0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.231897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6e132-2b13-414f-a24c-e68b903fc0af None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.232180 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6e132-2b13-414f-a24c-e68b903fc0af None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.232454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6e132-2b13-414f-a24c-e68b903fc0af None admin] PATH_INFO: `/v3/users/5f2e1d0eb5964af9aa4c1e99321ed32b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.233675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6e132-2b13-414f-a24c-e68b903fc0af None admin] RBAC: Authorizing `identity:get_user(user_id=5f2e1d0eb5964af9aa4c1e99321ed32b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:35.235092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6e132-2b13-414f-a24c-e68b903fc0af None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:35.236690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 556/1093] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:42:35 2022] GET /identity/v3/users/5f2e1d0eb5964af9aa4c1e99321ed32b => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:35.242227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6e132-2b13-414f-a24c-e68b903fc0af None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:35.281009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64741f89-814b-4a98-87f7-a97c21a6aca4 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.312918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a2108-5e03-4224-a64e-1bf573ebbdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.313730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2108-5e03-4224-a64e-1bf573ebbdef None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.314015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2108-5e03-4224-a64e-1bf573ebbdef None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.314295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2108-5e03-4224-a64e-1bf573ebbdef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.325838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a2108-5e03-4224-a64e-1bf573ebbdef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:35.327441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a2108-5e03-4224-a64e-1bf573ebbdef None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:35.340282 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6e132-2b13-414f-a24c-e68b903fc0af None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.343832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-5a2a2108-5e03-4224-a64e-1bf573ebbdef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:35.345031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 538/1094] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:35.350475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a2108-5e03-4224-a64e-1bf573ebbdef None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:35.372765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9dc15-c9c5-4a68-a4e8-f7682332168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.373404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9dc15-c9c5-4a68-a4e8-f7682332168a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.373726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9dc15-c9c5-4a68-a4e8-f7682332168a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.374007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9dc15-c9c5-4a68-a4e8-f7682332168a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.438139 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9dc15-c9c5-4a68-a4e8-f7682332168a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:35.439580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9dc15-c9c5-4a68-a4e8-f7682332168a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:35.443003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a2108-5e03-4224-a64e-1bf573ebbdef None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.474524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f19a0-e466-41b4-8859-f87293774698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.475112 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f19a0-e466-41b4-8859-f87293774698 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.475402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f19a0-e466-41b4-8859-f87293774698 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.475677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f19a0-e466-41b4-8859-f87293774698 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.476394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f19a0-e466-41b4-8859-f87293774698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:35.476702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f19a0-e466-41b4-8859-f87293774698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:35.478123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f19a0-e466-41b4-8859-f87293774698 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:35.489364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 539/1095] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:35.496157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f19a0-e466-41b4-8859-f87293774698 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:35.536299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 557/1096] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:42:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:42:35.542190 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9dc15-c9c5-4a68-a4e8-f7682332168a None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:35.590437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f19a0-e466-41b4-8859-f87293774698 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.623199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff38fb1-c917-4415-8f0b-e9a8c381a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.624019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff38fb1-c917-4415-8f0b-e9a8c381a680 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.624274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff38fb1-c917-4415-8f0b-e9a8c381a680 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.624552 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff38fb1-c917-4415-8f0b-e9a8c381a680 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.631460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff38fb1-c917-4415-8f0b-e9a8c381a680 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:35.632913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff38fb1-c917-4415-8f0b-e9a8c381a680 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:35.635204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9dc15-c9c5-4a68-a4e8-f7682332168a None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.646191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-7ff38fb1-c917-4415-8f0b-e9a8c381a680 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 06 12:42:35.647447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 540/1097] 10.222.0.23 () {56 vars in 1093 bytes} [Wed Apr 6 12:42:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:42:35.653138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff38fb1-c917-4415-8f0b-e9a8c381a680 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:35.668014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf327a-52a5-4f84-9c55-15e6b33913d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.668858 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf327a-52a5-4f84-9c55-15e6b33913d9 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.669140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf327a-52a5-4f84-9c55-15e6b33913d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.669414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf327a-52a5-4f84-9c55-15e6b33913d9 None admin] PATH_INFO: `/v3/projects/1235585fe70242f4a02f9013a3f6bcba` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.670681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf327a-52a5-4f84-9c55-15e6b33913d9 None admin] RBAC: Authorizing `identity:get_project(project_id=1235585fe70242f4a02f9013a3f6bcba)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:35.672119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf327a-52a5-4f84-9c55-15e6b33913d9 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:35.674078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 558/1098] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:42:35 2022] GET /identity/v3/projects/1235585fe70242f4a02f9013a3f6bcba => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:35.679859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf327a-52a5-4f84-9c55-15e6b33913d9 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:35.750793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff38fb1-c917-4415-8f0b-e9a8c381a680 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.771789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf327a-52a5-4f84-9c55-15e6b33913d9 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.783052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a4ade-1c1f-43e8-860b-21de1af89bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.783717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a4ade-1c1f-43e8-860b-21de1af89bfc None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.784002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a4ade-1c1f-43e8-860b-21de1af89bfc None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.784279 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a4ade-1c1f-43e8-860b-21de1af89bfc None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.785109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a4ade-1c1f-43e8-860b-21de1af89bfc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:35.785418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a4ade-1c1f-43e8-860b-21de1af89bfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:35.786900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a4ade-1c1f-43e8-860b-21de1af89bfc None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:35.809102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 541/1099] 10.222.0.23 () {56 vars in 1133 bytes} [Wed Apr 6 12:42:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:35.809269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fe676-0e2b-4885-bccf-499847bfa032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.809269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe676-0e2b-4885-bccf-499847bfa032 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.809269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe676-0e2b-4885-bccf-499847bfa032 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.809269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe676-0e2b-4885-bccf-499847bfa032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:35.809683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fe676-0e2b-4885-bccf-499847bfa032 None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=1235585fe70242f4a02f9013a3f6bcba, user.id=5f2e1d0eb5964af9aa4c1e99321ed32b) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:35.809683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fe676-0e2b-4885-bccf-499847bfa032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:35.809683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fe676-0e2b-4885-bccf-499847bfa032 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:35.810971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a4ade-1c1f-43e8-860b-21de1af89bfc None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:35.815056 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 559/1100] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:42:35 2022] GET /identity/v3/role_assignments?user.id=5f2e1d0eb5964af9aa4c1e99321ed32b&scope.project.id=1235585fe70242f4a02f9013a3f6bcba&role.id=c158bb1781c44a03890992161076b84b => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:42:35.912359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a4ade-1c1f-43e8-860b-21de1af89bfc None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:35.948008 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436ffb1-bbbf-4760-89b2-909b56acaac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:35.948678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ffb1-bbbf-4760-89b2-909b56acaac1 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:35.948964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ffb1-bbbf-4760-89b2-909b56acaac1 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:35.949241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ffb1-bbbf-4760-89b2-909b56acaac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:36.018268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436ffb1-bbbf-4760-89b2-909b56acaac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:36.019767 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436ffb1-bbbf-4760-89b2-909b56acaac1 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:36.113590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 542/1101] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:42:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 06 12:42:36.119535 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fe676-0e2b-4885-bccf-499847bfa032 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:36.211959 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fe676-0e2b-4885-bccf-499847bfa032 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:36.244380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977751e-7c66-49fe-9958-7781f7056b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:36.245155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977751e-7c66-49fe-9958-7781f7056b32 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:36.245433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977751e-7c66-49fe-9958-7781f7056b32 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:36.245736 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977751e-7c66-49fe-9958-7781f7056b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:36.255170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977751e-7c66-49fe-9958-7781f7056b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:36.256597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977751e-7c66-49fe-9958-7781f7056b32 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:36.272677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-8977751e-7c66-49fe-9958-7781f7056b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:42:36.273816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 560/1102] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:36.280184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436ffb1-bbbf-4760-89b2-909b56acaac1 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:36.375747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436ffb1-bbbf-4760-89b2-909b56acaac1 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:36.408135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dee4a-46ab-43db-bac7-ddafa447bb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:36.408783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dee4a-46ab-43db-bac7-ddafa447bb3b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:36.409063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dee4a-46ab-43db-bac7-ddafa447bb3b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:36.409342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16dee4a-46ab-43db-bac7-ddafa447bb3b None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:36.410088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dee4a-46ab-43db-bac7-ddafa447bb3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:36.410394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dee4a-46ab-43db-bac7-ddafa447bb3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:36.411771 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16dee4a-46ab-43db-bac7-ddafa447bb3b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:36.422482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 543/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:36.428301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977751e-7c66-49fe-9958-7781f7056b32 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:36.522952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977751e-7c66-49fe-9958-7781f7056b32 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:36.555959 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69b52a-c8ac-4317-b18d-282a6ab5e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:36.556901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69b52a-c8ac-4317-b18d-282a6ab5e96d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:36.557181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69b52a-c8ac-4317-b18d-282a6ab5e96d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:36.557456 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69b52a-c8ac-4317-b18d-282a6ab5e96d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:36.563883 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69b52a-c8ac-4317-b18d-282a6ab5e96d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:36.565317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69b52a-c8ac-4317-b18d-282a6ab5e96d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:36.578476 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-0e69b52a-c8ac-4317-b18d-282a6ab5e96d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:42:36.579644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 561/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:36.585485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dee4a-46ab-43db-bac7-ddafa447bb3b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:36.684032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16dee4a-46ab-43db-bac7-ddafa447bb3b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:36.716563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509cbf8-1685-4e25-9edc-61ec8c07efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:36.717221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509cbf8-1685-4e25-9edc-61ec8c07efae None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:36.717504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509cbf8-1685-4e25-9edc-61ec8c07efae None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:36.717807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509cbf8-1685-4e25-9edc-61ec8c07efae None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:36.718594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509cbf8-1685-4e25-9edc-61ec8c07efae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:36.718903 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509cbf8-1685-4e25-9edc-61ec8c07efae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:36.720354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509cbf8-1685-4e25-9edc-61ec8c07efae None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:36.732573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 544/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:36.738522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69b52a-c8ac-4317-b18d-282a6ab5e96d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:36.832224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69b52a-c8ac-4317-b18d-282a6ab5e96d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:36.863969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2491602-722a-480e-b62b-1ba8079b733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:36.864646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491602-722a-480e-b62b-1ba8079b733b None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:36.864918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491602-722a-480e-b62b-1ba8079b733b None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:36.865175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2491602-722a-480e-b62b-1ba8079b733b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:36.866071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2491602-722a-480e-b62b-1ba8079b733b None admin] RBAC: Adding query filter params (role.id=4900702c949549fd854b71b99b8faffb, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=65b295446c7741ea96caf60ac955d82d) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:36.866379 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2491602-722a-480e-b62b-1ba8079b733b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:36.867811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2491602-722a-480e-b62b-1ba8079b733b None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:36.874575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 562/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:42:36 2022] GET /identity/v3/role_assignments?user.id=65b295446c7741ea96caf60ac955d82d&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=4900702c949549fd854b71b99b8faffb => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:38.148804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81d03-51c0-4758-9423-505f5d6fccd6 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:38.149337 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81d03-51c0-4758-9423-505f5d6fccd6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:38.149337 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a81d03-51c0-4758-9423-505f5d6fccd6 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:38.151408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 545/1107] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:38.156483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64d86-03bd-4384-b78d-fdea7f60d7ed None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:38.156888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64d86-03bd-4384-b78d-fdea7f60d7ed None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:38.157031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb64d86-03bd-4384-b78d-fdea7f60d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:38.174308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-4cb64d86-03bd-4384-b78d-fdea7f60d7ed None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:38.175500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4cb64d86-03bd-4384-b78d-fdea7f60d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:38.243524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 563/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:38.269881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a81d03-51c0-4758-9423-505f5d6fccd6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:38.365234 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a81d03-51c0-4758-9423-505f5d6fccd6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:38.397420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503c3fa-3ada-41d6-944e-7e1650477884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:38.398227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503c3fa-3ada-41d6-944e-7e1650477884 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:38.398504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503c3fa-3ada-41d6-944e-7e1650477884 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:38.398772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503c3fa-3ada-41d6-944e-7e1650477884 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:38.399993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503c3fa-3ada-41d6-944e-7e1650477884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:38.401508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503c3fa-3ada-41d6-944e-7e1650477884 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:38.403148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 546/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:38.408867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb64d86-03bd-4384-b78d-fdea7f60d7ed None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:38.505410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb64d86-03bd-4384-b78d-fdea7f60d7ed None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:38.538288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b60d0-38eb-46f1-854d-0b96fd6a3a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:38.538944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b60d0-38eb-46f1-854d-0b96fd6a3a8f None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:38.539227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b60d0-38eb-46f1-854d-0b96fd6a3a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:38.539501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b60d0-38eb-46f1-854d-0b96fd6a3a8f None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:38.540203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b60d0-38eb-46f1-854d-0b96fd6a3a8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:38.542277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b60d0-38eb-46f1-854d-0b96fd6a3a8f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:38.561841 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 564/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:42:38 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:40.903158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157764-8655-46b6-8c40-8adf5bc798d8 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:40.903698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157764-8655-46b6-8c40-8adf5bc798d8 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:40.903698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f157764-8655-46b6-8c40-8adf5bc798d8 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:40.905051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 547/1111] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:40.910139 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb6f4-27b0-4784-9469-33b60e8071fd None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:40.910565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb6f4-27b0-4784-9469-33b60e8071fd None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:40.910697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fb6f4-27b0-4784-9469-33b60e8071fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:40.927641 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-4c6fb6f4-27b0-4784-9469-33b60e8071fd None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:40.928815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4c6fb6f4-27b0-4784-9469-33b60e8071fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:40.994696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 565/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:41.019525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f157764-8655-46b6-8c40-8adf5bc798d8 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:41.113884 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f157764-8655-46b6-8c40-8adf5bc798d8 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:41.145947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd8567-bd9e-4e66-990d-bcb722ed856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:41.146807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd8567-bd9e-4e66-990d-bcb722ed856f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:41.147089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd8567-bd9e-4e66-990d-bcb722ed856f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:41.147362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd8567-bd9e-4e66-990d-bcb722ed856f None admin] PATH_INFO: `/v3/roles/82e7000d778e4c66a98f07a93e8ae084` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:41.148832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd8567-bd9e-4e66-990d-bcb722ed856f None admin] RBAC: Authorizing `identity:get_role(role_id=82e7000d778e4c66a98f07a93e8ae084)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:41.150309 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd8567-bd9e-4e66-990d-bcb722ed856f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:41.151780 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 548/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:42:41 2022] GET /identity/v3/roles/82e7000d778e4c66a98f07a93e8ae084 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:41.157654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb6f4-27b0-4784-9469-33b60e8071fd None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:41.250483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fb6f4-27b0-4784-9469-33b60e8071fd None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:41.282173 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a5836-9fd3-4ab5-96bc-0c3da7eb1384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:41.283029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a5836-9fd3-4ab5-96bc-0c3da7eb1384 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:41.283310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a5836-9fd3-4ab5-96bc-0c3da7eb1384 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:41.283582 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a5836-9fd3-4ab5-96bc-0c3da7eb1384 None admin] PATH_INFO: `/v3/users/f39798e7efc548a68864513fe4014ec8` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:41.296517 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a5836-9fd3-4ab5-96bc-0c3da7eb1384 None admin] RBAC: Authorizing `identity:get_user(user_id=f39798e7efc548a68864513fe4014ec8)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:41.297989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a5836-9fd3-4ab5-96bc-0c3da7eb1384 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:41.299862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 566/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:42:41 2022] GET /identity/v3/users/f39798e7efc548a68864513fe4014ec8 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:41.305664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd8567-bd9e-4e66-990d-bcb722ed856f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:41.400814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd8567-bd9e-4e66-990d-bcb722ed856f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:41.432885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db508-bd34-4392-b6b9-83152b5bf686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:41.433469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db508-bd34-4392-b6b9-83152b5bf686 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:41.433782 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db508-bd34-4392-b6b9-83152b5bf686 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:41.434062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db508-bd34-4392-b6b9-83152b5bf686 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:41.498123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db508-bd34-4392-b6b9-83152b5bf686 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:41.499601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db508-bd34-4392-b6b9-83152b5bf686 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:41.600492 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 549/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:42:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:42:41.606926 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a5836-9fd3-4ab5-96bc-0c3da7eb1384 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:41.700536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a5836-9fd3-4ab5-96bc-0c3da7eb1384 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:41.732402 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858afca-319f-42c8-913c-8e805701bfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:41.733237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858afca-319f-42c8-913c-8e805701bfe7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:41.733516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858afca-319f-42c8-913c-8e805701bfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:41.733814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858afca-319f-42c8-913c-8e805701bfe7 None admin] PATH_INFO: `/v3/projects/1235585fe70242f4a02f9013a3f6bcba` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:41.734963 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858afca-319f-42c8-913c-8e805701bfe7 None admin] RBAC: Authorizing `identity:get_project(project_id=1235585fe70242f4a02f9013a3f6bcba)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:41.736376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858afca-319f-42c8-913c-8e805701bfe7 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:41.738053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 567/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:42:41 2022] GET /identity/v3/projects/1235585fe70242f4a02f9013a3f6bcba => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:41.744018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db508-bd34-4392-b6b9-83152b5bf686 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:41.836504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db508-bd34-4392-b6b9-83152b5bf686 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:41.868163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7da71-da64-4762-8714-3a0898b0655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:41.869013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7da71-da64-4762-8714-3a0898b0655f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:41.869299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7da71-da64-4762-8714-3a0898b0655f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:41.869605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7da71-da64-4762-8714-3a0898b0655f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:41.870413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7da71-da64-4762-8714-3a0898b0655f None admin] RBAC: Adding query filter params (role.id=82e7000d778e4c66a98f07a93e8ae084, scope.project.id=1235585fe70242f4a02f9013a3f6bcba, user.id=f39798e7efc548a68864513fe4014ec8) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:41.870717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7da71-da64-4762-8714-3a0898b0655f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:41.872163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7da71-da64-4762-8714-3a0898b0655f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:41.877380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 550/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:42:41 2022] GET /identity/v3/role_assignments?user.id=f39798e7efc548a68864513fe4014ec8&scope.project.id=1235585fe70242f4a02f9013a3f6bcba&role.id=82e7000d778e4c66a98f07a93e8ae084 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:44.140023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418313-47f6-45b7-9251-f9ab24b3f73d None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:44.140574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418313-47f6-45b7-9251-f9ab24b3f73d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:44.140574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f418313-47f6-45b7-9251-f9ab24b3f73d None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:44.141953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 568/1118] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:44.147246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b42706-68e8-4333-bbdd-4e21e2913b9a None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:44.147653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b42706-68e8-4333-bbdd-4e21e2913b9a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:44.147798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b42706-68e8-4333-bbdd-4e21e2913b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:44.164005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-90b42706-68e8-4333-bbdd-4e21e2913b9a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:44.165188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-90b42706-68e8-4333-bbdd-4e21e2913b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:44.227394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 551/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:44.250186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418313-47f6-45b7-9251-f9ab24b3f73d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:44.346340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f418313-47f6-45b7-9251-f9ab24b3f73d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:44.379561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58699d66-6269-4480-aedc-53174e7f0df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:44.380406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58699d66-6269-4480-aedc-53174e7f0df7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:44.380688 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58699d66-6269-4480-aedc-53174e7f0df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:44.380964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58699d66-6269-4480-aedc-53174e7f0df7 None admin] PATH_INFO: `/v3/roles/82e7000d778e4c66a98f07a93e8ae084` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:44.382454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58699d66-6269-4480-aedc-53174e7f0df7 None admin] RBAC: Authorizing `identity:get_role(role_id=82e7000d778e4c66a98f07a93e8ae084)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:44.383848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58699d66-6269-4480-aedc-53174e7f0df7 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:44.385309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 569/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:42:44 2022] GET /identity/v3/roles/82e7000d778e4c66a98f07a93e8ae084 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:44.391321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b42706-68e8-4333-bbdd-4e21e2913b9a None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:44.485773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b42706-68e8-4333-bbdd-4e21e2913b9a None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:44.517324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f455a4-3ad7-4466-ad88-2bcd9a14fcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:44.518211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f455a4-3ad7-4466-ad88-2bcd9a14fcda None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:44.518493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f455a4-3ad7-4466-ad88-2bcd9a14fcda None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:44.518764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f455a4-3ad7-4466-ad88-2bcd9a14fcda None admin] PATH_INFO: `/v3/users/f39798e7efc548a68864513fe4014ec8` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:44.519939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f455a4-3ad7-4466-ad88-2bcd9a14fcda None admin] RBAC: Authorizing `identity:get_user(user_id=f39798e7efc548a68864513fe4014ec8)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:44.521400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f455a4-3ad7-4466-ad88-2bcd9a14fcda None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:44.523062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 552/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:42:44 2022] GET /identity/v3/users/f39798e7efc548a68864513fe4014ec8 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:44.529527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58699d66-6269-4480-aedc-53174e7f0df7 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:44.624526 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58699d66-6269-4480-aedc-53174e7f0df7 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:44.657010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a54b7a-8215-4b0b-99b7-5be41bfb1309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:44.657821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54b7a-8215-4b0b-99b7-5be41bfb1309 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:44.658104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54b7a-8215-4b0b-99b7-5be41bfb1309 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:44.658375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54b7a-8215-4b0b-99b7-5be41bfb1309 None admin] PATH_INFO: `/v3/projects/1235585fe70242f4a02f9013a3f6bcba` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:44.659544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a54b7a-8215-4b0b-99b7-5be41bfb1309 None admin] RBAC: Authorizing `identity:get_project(project_id=1235585fe70242f4a02f9013a3f6bcba)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:44.660972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a54b7a-8215-4b0b-99b7-5be41bfb1309 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:44.662664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 570/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:42:44 2022] GET /identity/v3/projects/1235585fe70242f4a02f9013a3f6bcba => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:44.669986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f455a4-3ad7-4466-ad88-2bcd9a14fcda None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:44.764660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f455a4-3ad7-4466-ad88-2bcd9a14fcda None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:44.797877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc7f2f-939a-47fd-ac16-1bd9ed92f589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:44.799009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc7f2f-939a-47fd-ac16-1bd9ed92f589 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:44.799290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc7f2f-939a-47fd-ac16-1bd9ed92f589 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:44.799580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc7f2f-939a-47fd-ac16-1bd9ed92f589 None admin] PATH_INFO: `/v3/projects/1235585fe70242f4a02f9013a3f6bcba/users/f39798e7efc548a68864513fe4014ec8/roles/82e7000d778e4c66a98f07a93e8ae084` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:44.801764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc7f2f-939a-47fd-ac16-1bd9ed92f589 None admin] RBAC: Authorizing `identity:create_grant(project_id=1235585fe70242f4a02f9013a3f6bcba, user_id=f39798e7efc548a68864513fe4014ec8, role_id=82e7000d778e4c66a98f07a93e8ae084)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:44.803226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc7f2f-939a-47fd-ac16-1bd9ed92f589 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:44.815608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 553/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:42:44 2022] PUT /identity/v3/projects/1235585fe70242f4a02f9013a3f6bcba/users/f39798e7efc548a68864513fe4014ec8/roles/82e7000d778e4c66a98f07a93e8ae084 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:42:47.113027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab504b-a19e-4f10-8f6d-c84fe2f8d366 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:47.113558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab504b-a19e-4f10-8f6d-c84fe2f8d366 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:47.113558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab504b-a19e-4f10-8f6d-c84fe2f8d366 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:47.114957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 571/1124] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:47.120671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78469-57c5-4940-a1c6-51499776192b None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:47.121093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78469-57c5-4940-a1c6-51499776192b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:47.121229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78469-57c5-4940-a1c6-51499776192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:47.138011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-2ab78469-57c5-4940-a1c6-51499776192b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:47.139166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2ab78469-57c5-4940-a1c6-51499776192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:47.201160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 554/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:47.226204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab504b-a19e-4f10-8f6d-c84fe2f8d366 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:47.321638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab504b-a19e-4f10-8f6d-c84fe2f8d366 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:47.360723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03f40d-1d76-4f53-82f8-edc81dff6d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:47.361596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03f40d-1d76-4f53-82f8-edc81dff6d59 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:47.361892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03f40d-1d76-4f53-82f8-edc81dff6d59 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:47.362168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03f40d-1d76-4f53-82f8-edc81dff6d59 None admin] PATH_INFO: `/v3/roles/82e7000d778e4c66a98f07a93e8ae084` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:47.363705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03f40d-1d76-4f53-82f8-edc81dff6d59 None admin] RBAC: Authorizing `identity:get_role(role_id=82e7000d778e4c66a98f07a93e8ae084)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:47.365023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03f40d-1d76-4f53-82f8-edc81dff6d59 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:47.366434 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 572/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:42:47 2022] GET /identity/v3/roles/82e7000d778e4c66a98f07a93e8ae084 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:47.372478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab78469-57c5-4940-a1c6-51499776192b None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:47.464199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab78469-57c5-4940-a1c6-51499776192b None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:47.496148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7b381-817a-4819-ba84-e2885aed449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:47.497001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7b381-817a-4819-ba84-e2885aed449c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:47.497279 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7b381-817a-4819-ba84-e2885aed449c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:47.497551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7b381-817a-4819-ba84-e2885aed449c None admin] PATH_INFO: `/v3/users/f39798e7efc548a68864513fe4014ec8` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:47.498745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7b381-817a-4819-ba84-e2885aed449c None admin] RBAC: Authorizing `identity:get_user(user_id=f39798e7efc548a68864513fe4014ec8)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:47.500189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7b381-817a-4819-ba84-e2885aed449c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:47.501837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 555/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:42:47 2022] GET /identity/v3/users/f39798e7efc548a68864513fe4014ec8 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:47.507617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03f40d-1d76-4f53-82f8-edc81dff6d59 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:47.608925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03f40d-1d76-4f53-82f8-edc81dff6d59 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:47.642380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cd32e-e20c-49ed-8dfc-236965886564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:47.642946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cd32e-e20c-49ed-8dfc-236965886564 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:47.643222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cd32e-e20c-49ed-8dfc-236965886564 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:47.643489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cd32e-e20c-49ed-8dfc-236965886564 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:47.706695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cd32e-e20c-49ed-8dfc-236965886564 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:47.708134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cd32e-e20c-49ed-8dfc-236965886564 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:47.799033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 573/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:42:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:42:47.804875 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7b381-817a-4819-ba84-e2885aed449c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:47.898212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7b381-817a-4819-ba84-e2885aed449c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:47.930473 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea88fc-dc3d-491d-95f7-19fcf759a9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:47.931872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea88fc-dc3d-491d-95f7-19fcf759a9e3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:47.932159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea88fc-dc3d-491d-95f7-19fcf759a9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:47.932415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea88fc-dc3d-491d-95f7-19fcf759a9e3 None admin] PATH_INFO: `/v3/projects/1235585fe70242f4a02f9013a3f6bcba` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:47.933607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea88fc-dc3d-491d-95f7-19fcf759a9e3 None admin] RBAC: Authorizing `identity:get_project(project_id=1235585fe70242f4a02f9013a3f6bcba)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:47.935058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea88fc-dc3d-491d-95f7-19fcf759a9e3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:47.936748 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 556/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:42:47 2022] GET /identity/v3/projects/1235585fe70242f4a02f9013a3f6bcba => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:47.942825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cd32e-e20c-49ed-8dfc-236965886564 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:48.060060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cd32e-e20c-49ed-8dfc-236965886564 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:48.099364 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b2650-c059-44c5-9618-fdfa288d7603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:48.100006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b2650-c059-44c5-9618-fdfa288d7603 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:48.100283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b2650-c059-44c5-9618-fdfa288d7603 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:48.100553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b2650-c059-44c5-9618-fdfa288d7603 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:48.101369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b2650-c059-44c5-9618-fdfa288d7603 None admin] RBAC: Adding query filter params (role.id=82e7000d778e4c66a98f07a93e8ae084, scope.project.id=1235585fe70242f4a02f9013a3f6bcba, user.id=f39798e7efc548a68864513fe4014ec8) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:48.101706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b2650-c059-44c5-9618-fdfa288d7603 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:48.103195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b2650-c059-44c5-9618-fdfa288d7603 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:48.108694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 574/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:42:47 2022] GET /identity/v3/role_assignments?user.id=f39798e7efc548a68864513fe4014ec8&scope.project.id=1235585fe70242f4a02f9013a3f6bcba&role.id=82e7000d778e4c66a98f07a93e8ae084 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:50.498713 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe01c-7ce6-4b0e-9c2c-270da2a52806 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:50.499237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe01c-7ce6-4b0e-9c2c-270da2a52806 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:50.499237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabe01c-7ce6-4b0e-9c2c-270da2a52806 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:50.500611 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 557/1131] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:50.505727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74121cf-421d-4aa4-925a-759ccba4d54f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:50.506145 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74121cf-421d-4aa4-925a-759ccba4d54f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:50.506290 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74121cf-421d-4aa4-925a-759ccba4d54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:50.523777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-a74121cf-421d-4aa4-925a-759ccba4d54f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:50.526021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a74121cf-421d-4aa4-925a-759ccba4d54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:50.591801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 575/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:50.616426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe01c-7ce6-4b0e-9c2c-270da2a52806 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:50.711032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabe01c-7ce6-4b0e-9c2c-270da2a52806 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:50.742401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fa6ec-2609-415b-a2d2-274e87630f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:50.743201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa6ec-2609-415b-a2d2-274e87630f04 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:50.743544 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa6ec-2609-415b-a2d2-274e87630f04 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:50.743820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa6ec-2609-415b-a2d2-274e87630f04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:50.744978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fa6ec-2609-415b-a2d2-274e87630f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:50.746458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fa6ec-2609-415b-a2d2-274e87630f04 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:50.748054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 558/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:50.753867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74121cf-421d-4aa4-925a-759ccba4d54f None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:50.846062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74121cf-421d-4aa4-925a-759ccba4d54f None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:50.876905 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcf43c-7bcb-4478-b4ce-d5b28e315aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:50.877552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf43c-7bcb-4478-b4ce-d5b28e315aa0 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:50.877868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf43c-7bcb-4478-b4ce-d5b28e315aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:50.878142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcf43c-7bcb-4478-b4ce-d5b28e315aa0 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:50.878842 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcf43c-7bcb-4478-b4ce-d5b28e315aa0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:50.880256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcf43c-7bcb-4478-b4ce-d5b28e315aa0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:50.904387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 576/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:42:50 2022] POST /identity/v3/projects => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:53.231992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b530f1-b9bf-45ae-97a8-1ab6a9938efa None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:53.232524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b530f1-b9bf-45ae-97a8-1ab6a9938efa None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:53.232524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b530f1-b9bf-45ae-97a8-1ab6a9938efa None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:53.233941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 559/1135] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:53.239141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748cc64-b657-48f4-84c1-f8d6a3e64c7b None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:53.239538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748cc64-b657-48f4-84c1-f8d6a3e64c7b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:53.239702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748cc64-b657-48f4-84c1-f8d6a3e64c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:53.256014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-1748cc64-b657-48f4-84c1-f8d6a3e64c7b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:53.257175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1748cc64-b657-48f4-84c1-f8d6a3e64c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:53.319261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 577/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:53.346022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b530f1-b9bf-45ae-97a8-1ab6a9938efa None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:53.441471 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b530f1-b9bf-45ae-97a8-1ab6a9938efa None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:53.472919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e00f2-29ae-408e-9997-6481c116223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:53.473727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e00f2-29ae-408e-9997-6481c116223f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:53.474012 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e00f2-29ae-408e-9997-6481c116223f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:53.474285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e00f2-29ae-408e-9997-6481c116223f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:53.475443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e00f2-29ae-408e-9997-6481c116223f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:53.476893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e00f2-29ae-408e-9997-6481c116223f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:53.479153 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 560/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:53.485040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748cc64-b657-48f4-84c1-f8d6a3e64c7b None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:53.577222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748cc64-b657-48f4-84c1-f8d6a3e64c7b None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:53.610324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749f46c-7091-4aa7-82bc-01da9ae52991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:53.610994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749f46c-7091-4aa7-82bc-01da9ae52991 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:53.611277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749f46c-7091-4aa7-82bc-01da9ae52991 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:53.611554 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749f46c-7091-4aa7-82bc-01da9ae52991 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:53.612272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749f46c-7091-4aa7-82bc-01da9ae52991 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:53.613743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749f46c-7091-4aa7-82bc-01da9ae52991 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:53.633075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 578/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:42:53 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:42:55.998255 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda51c8-ca6f-4c80-8e81-16d7c1fce979 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:55.998839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda51c8-ca6f-4c80-8e81-16d7c1fce979 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:55.998839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda51c8-ca6f-4c80-8e81-16d7c1fce979 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:56.000171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 561/1139] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:56.005386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01cd8c-445c-4be9-8c5a-e2d205726e5d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:56.005864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01cd8c-445c-4be9-8c5a-e2d205726e5d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:56.005958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01cd8c-445c-4be9-8c5a-e2d205726e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:56.023846 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-0e01cd8c-445c-4be9-8c5a-e2d205726e5d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:56.026331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0e01cd8c-445c-4be9-8c5a-e2d205726e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:56.094819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 579/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:56.120099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda51c8-ca6f-4c80-8e81-16d7c1fce979 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:56.219321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda51c8-ca6f-4c80-8e81-16d7c1fce979 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:56.259464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2321561-8534-40b8-9472-9bfbe48af217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:56.260333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2321561-8534-40b8-9472-9bfbe48af217 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:56.260560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2321561-8534-40b8-9472-9bfbe48af217 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:56.260879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2321561-8534-40b8-9472-9bfbe48af217 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:56.270697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2321561-8534-40b8-9472-9bfbe48af217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:56.277737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-f2321561-8534-40b8-9472-9bfbe48af217 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:42:56.278922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 562/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:56.285176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01cd8c-445c-4be9-8c5a-e2d205726e5d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:56.381454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01cd8c-445c-4be9-8c5a-e2d205726e5d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:56.417295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764cfa6-f44a-4864-9726-c64de09548ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:56.418072 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764cfa6-f44a-4864-9726-c64de09548ce None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:56.418358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764cfa6-f44a-4864-9726-c64de09548ce None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:56.418713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764cfa6-f44a-4864-9726-c64de09548ce None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:56.419488 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764cfa6-f44a-4864-9726-c64de09548ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:56.419830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764cfa6-f44a-4864-9726-c64de09548ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:56.421322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764cfa6-f44a-4864-9726-c64de09548ce None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:56.430094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 580/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:42:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:56.436778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2321561-8534-40b8-9472-9bfbe48af217 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:56.658742 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2321561-8534-40b8-9472-9bfbe48af217 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:56.690754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138dab-efd7-4562-a056-7ef3e628a291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:56.691609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138dab-efd7-4562-a056-7ef3e628a291 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:56.691888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138dab-efd7-4562-a056-7ef3e628a291 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:56.692160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138dab-efd7-4562-a056-7ef3e628a291 None admin] PATH_INFO: `/v3/users/66438ca8ca85492aa1e3cf8bd2b3645f` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:56.705327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61138dab-efd7-4562-a056-7ef3e628a291 None admin] RBAC: Authorizing `identity:get_user(user_id=66438ca8ca85492aa1e3cf8bd2b3645f)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:56.706830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61138dab-efd7-4562-a056-7ef3e628a291 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:56.708462 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 563/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:42:56 2022] GET /identity/v3/users/66438ca8ca85492aa1e3cf8bd2b3645f => generated 286 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:56.714500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764cfa6-f44a-4864-9726-c64de09548ce None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:56.812451 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764cfa6-f44a-4864-9726-c64de09548ce None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:56.845339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7f66f-8290-47dd-9627-ee0febfc03ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:56.846057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7f66f-8290-47dd-9627-ee0febfc03ad None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:56.846346 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7f66f-8290-47dd-9627-ee0febfc03ad None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:56.846626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7f66f-8290-47dd-9627-ee0febfc03ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:56.911345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7f66f-8290-47dd-9627-ee0febfc03ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:56.912741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7f66f-8290-47dd-9627-ee0febfc03ad None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:57.008755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 581/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:42:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:42:57.014944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138dab-efd7-4562-a056-7ef3e628a291 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:57.106885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138dab-efd7-4562-a056-7ef3e628a291 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:57.137969 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8bf0e-5764-4b23-a909-873a0e144105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:57.138816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8bf0e-5764-4b23-a909-873a0e144105 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:57.139091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8bf0e-5764-4b23-a909-873a0e144105 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:57.139358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8bf0e-5764-4b23-a909-873a0e144105 None admin] PATH_INFO: `/v3/projects/4858370d2e264d0aa5d0dd20a9eb68e1` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:57.140504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8bf0e-5764-4b23-a909-873a0e144105 None admin] RBAC: Authorizing `identity:get_project(project_id=4858370d2e264d0aa5d0dd20a9eb68e1)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:57.141960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8bf0e-5764-4b23-a909-873a0e144105 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:57.143631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 564/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:42:57 2022] GET /identity/v3/projects/4858370d2e264d0aa5d0dd20a9eb68e1 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:57.150592 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7f66f-8290-47dd-9627-ee0febfc03ad None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:57.245303 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7f66f-8290-47dd-9627-ee0febfc03ad None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:57.277214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe446d-0dfd-42b9-a99e-7ae32318dd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:57.277875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe446d-0dfd-42b9-a99e-7ae32318dd58 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:57.278158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe446d-0dfd-42b9-a99e-7ae32318dd58 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:57.278431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe446d-0dfd-42b9-a99e-7ae32318dd58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:57.279254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe446d-0dfd-42b9-a99e-7ae32318dd58 None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=4858370d2e264d0aa5d0dd20a9eb68e1, user.id=66438ca8ca85492aa1e3cf8bd2b3645f) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:42:57.279563 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe446d-0dfd-42b9-a99e-7ae32318dd58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:42:57.280979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe446d-0dfd-42b9-a99e-7ae32318dd58 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:42:57.286089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 582/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:42:57 2022] GET /identity/v3/role_assignments?user.id=66438ca8ca85492aa1e3cf8bd2b3645f&scope.project.id=4858370d2e264d0aa5d0dd20a9eb68e1&role.id=c158bb1781c44a03890992161076b84b => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:42:59.647829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad97ef8-86ec-4dd3-87e6-829b8780182f None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:59.648379 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad97ef8-86ec-4dd3-87e6-829b8780182f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:59.648478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad97ef8-86ec-4dd3-87e6-829b8780182f None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:59.650612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 565/1147] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:42:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:42:59.655931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c876d3-45a5-4429-ab04-f872147f50c7 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:59.656377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c876d3-45a5-4429-ab04-f872147f50c7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:59.656478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c876d3-45a5-4429-ab04-f872147f50c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:59.673688 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-60c876d3-45a5-4429-ab04-f872147f50c7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:42:59.674856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-60c876d3-45a5-4429-ab04-f872147f50c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:42:59.737209 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 583/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:42:59.761010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad97ef8-86ec-4dd3-87e6-829b8780182f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:42:59.856164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad97ef8-86ec-4dd3-87e6-829b8780182f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:42:59.889071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eeea4-666a-485c-ad2b-d036e870574d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:42:59.889882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eeea4-666a-485c-ad2b-d036e870574d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:42:59.890166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eeea4-666a-485c-ad2b-d036e870574d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:42:59.890438 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eeea4-666a-485c-ad2b-d036e870574d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:42:59.900245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141eeea4-666a-485c-ad2b-d036e870574d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:42:59.907048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-141eeea4-666a-485c-ad2b-d036e870574d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:42:59.908241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 566/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:42:59.916330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c876d3-45a5-4429-ab04-f872147f50c7 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:00.013639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c876d3-45a5-4429-ab04-f872147f50c7 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:00.046735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a9222-8917-40f6-95f0-e12dd344b91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:00.047386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a9222-8917-40f6-95f0-e12dd344b91a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:00.047669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a9222-8917-40f6-95f0-e12dd344b91a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:00.047947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a9222-8917-40f6-95f0-e12dd344b91a None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:00.048939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a9222-8917-40f6-95f0-e12dd344b91a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:43:00.049239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a9222-8917-40f6-95f0-e12dd344b91a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:00.050637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a9222-8917-40f6-95f0-e12dd344b91a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:00.058307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 584/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:00.064266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eeea4-666a-485c-ad2b-d036e870574d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:00.157068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eeea4-666a-485c-ad2b-d036e870574d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:00.189252 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0689e12-c616-434a-9093-03e743b0277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:00.190137 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0689e12-c616-434a-9093-03e743b0277a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:00.190420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0689e12-c616-434a-9093-03e743b0277a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:00.190691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0689e12-c616-434a-9093-03e743b0277a None admin] PATH_INFO: `/v3/users/66438ca8ca85492aa1e3cf8bd2b3645f` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:00.191871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0689e12-c616-434a-9093-03e743b0277a None admin] RBAC: Authorizing `identity:get_user(user_id=66438ca8ca85492aa1e3cf8bd2b3645f)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:00.193318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0689e12-c616-434a-9093-03e743b0277a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:00.194959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 567/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:43:00 2022] GET /identity/v3/users/66438ca8ca85492aa1e3cf8bd2b3645f => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:00.200772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a9222-8917-40f6-95f0-e12dd344b91a None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:00.296247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a9222-8917-40f6-95f0-e12dd344b91a None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:00.328614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7ee44-a400-4648-8f33-87d4efd4d65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:00.329465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ee44-a400-4648-8f33-87d4efd4d65c None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:00.329775 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ee44-a400-4648-8f33-87d4efd4d65c None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:00.330050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7ee44-a400-4648-8f33-87d4efd4d65c None admin] PATH_INFO: `/v3/projects/4858370d2e264d0aa5d0dd20a9eb68e1` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:00.331221 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7ee44-a400-4648-8f33-87d4efd4d65c None admin] RBAC: Authorizing `identity:get_project(project_id=4858370d2e264d0aa5d0dd20a9eb68e1)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:00.332660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7ee44-a400-4648-8f33-87d4efd4d65c None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:00.334369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 585/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:43:00 2022] GET /identity/v3/projects/4858370d2e264d0aa5d0dd20a9eb68e1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:00.340996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0689e12-c616-434a-9093-03e743b0277a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:00.436388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0689e12-c616-434a-9093-03e743b0277a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:00.472247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85f89a-b431-4095-ab2a-a0544910f296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:00.473233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85f89a-b431-4095-ab2a-a0544910f296 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:00.473544 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85f89a-b431-4095-ab2a-a0544910f296 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:00.473857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85f89a-b431-4095-ab2a-a0544910f296 None admin] PATH_INFO: `/v3/projects/4858370d2e264d0aa5d0dd20a9eb68e1/users/66438ca8ca85492aa1e3cf8bd2b3645f/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:00.475860 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85f89a-b431-4095-ab2a-a0544910f296 None admin] RBAC: Authorizing `identity:create_grant(project_id=4858370d2e264d0aa5d0dd20a9eb68e1, user_id=66438ca8ca85492aa1e3cf8bd2b3645f, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:00.477406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85f89a-b431-4095-ab2a-a0544910f296 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:00.490170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 568/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:43:00 2022] PUT /identity/v3/projects/4858370d2e264d0aa5d0dd20a9eb68e1/users/66438ca8ca85492aa1e3cf8bd2b3645f/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:43:02.787724 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d77a6-a61a-4636-9b20-384529285582 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:02.788293 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d77a6-a61a-4636-9b20-384529285582 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:02.788293 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d77a6-a61a-4636-9b20-384529285582 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:02.790166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 586/1154] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:43:02.795678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd282214-20cc-4f46-984c-a84378d636e8 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:02.796117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd282214-20cc-4f46-984c-a84378d636e8 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:02.796225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd282214-20cc-4f46-984c-a84378d636e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:02.813433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-bd282214-20cc-4f46-984c-a84378d636e8 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:43:02.814630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bd282214-20cc-4f46-984c-a84378d636e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:43:02.894200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 569/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:43:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:43:02.921705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d77a6-a61a-4636-9b20-384529285582 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:03.027244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d77a6-a61a-4636-9b20-384529285582 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:03.064333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ed7f9-6019-4bc7-a154-8e7ea474816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:03.065234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ed7f9-6019-4bc7-a154-8e7ea474816d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:03.065520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ed7f9-6019-4bc7-a154-8e7ea474816d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:03.065825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ed7f9-6019-4bc7-a154-8e7ea474816d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:03.078218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ed7f9-6019-4bc7-a154-8e7ea474816d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:43:03.085344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-b60ed7f9-6019-4bc7-a154-8e7ea474816d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:43:03.087157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 587/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:43:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:43:03.094450 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd282214-20cc-4f46-984c-a84378d636e8 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:03.193002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd282214-20cc-4f46-984c-a84378d636e8 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:03.227505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1842a-52c3-4fa5-8e3f-c0eb21af4a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:03.228416 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1842a-52c3-4fa5-8e3f-c0eb21af4a97 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:03.228693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1842a-52c3-4fa5-8e3f-c0eb21af4a97 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:03.228962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1842a-52c3-4fa5-8e3f-c0eb21af4a97 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:03.229850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1842a-52c3-4fa5-8e3f-c0eb21af4a97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:43:03.230156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1842a-52c3-4fa5-8e3f-c0eb21af4a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:03.231571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1842a-52c3-4fa5-8e3f-c0eb21af4a97 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:03.244142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 570/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:43:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:03.250178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ed7f9-6019-4bc7-a154-8e7ea474816d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:03.349025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ed7f9-6019-4bc7-a154-8e7ea474816d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:03.381201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930c6c6-46b5-443a-a7d9-f21b84a83c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:03.382136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930c6c6-46b5-443a-a7d9-f21b84a83c60 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:03.382417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930c6c6-46b5-443a-a7d9-f21b84a83c60 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:03.382685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930c6c6-46b5-443a-a7d9-f21b84a83c60 None admin] PATH_INFO: `/v3/users/66438ca8ca85492aa1e3cf8bd2b3645f` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:03.384401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930c6c6-46b5-443a-a7d9-f21b84a83c60 None admin] RBAC: Authorizing `identity:get_user(user_id=66438ca8ca85492aa1e3cf8bd2b3645f)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:03.385966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930c6c6-46b5-443a-a7d9-f21b84a83c60 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:03.387588 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 588/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:43:03 2022] GET /identity/v3/users/66438ca8ca85492aa1e3cf8bd2b3645f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:03.393370 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1842a-52c3-4fa5-8e3f-c0eb21af4a97 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:03.488892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1842a-52c3-4fa5-8e3f-c0eb21af4a97 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:03.520542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9b5a9-ac60-4867-872c-836fabd13e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:03.521176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b5a9-ac60-4867-872c-836fabd13e49 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:03.521454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b5a9-ac60-4867-872c-836fabd13e49 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:03.521756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9b5a9-ac60-4867-872c-836fabd13e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:03.585323 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9b5a9-ac60-4867-872c-836fabd13e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:03.587587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9b5a9-ac60-4867-872c-836fabd13e49 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:03.686446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 571/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:43:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:43:03.692365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930c6c6-46b5-443a-a7d9-f21b84a83c60 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:03.792651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930c6c6-46b5-443a-a7d9-f21b84a83c60 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:03.826669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f71f1-21d9-4386-8c94-f00b1b288135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:03.827521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f71f1-21d9-4386-8c94-f00b1b288135 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:03.827803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f71f1-21d9-4386-8c94-f00b1b288135 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:03.828107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f71f1-21d9-4386-8c94-f00b1b288135 None admin] PATH_INFO: `/v3/projects/4858370d2e264d0aa5d0dd20a9eb68e1` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:03.829342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f71f1-21d9-4386-8c94-f00b1b288135 None admin] RBAC: Authorizing `identity:get_project(project_id=4858370d2e264d0aa5d0dd20a9eb68e1)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:03.831073 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f71f1-21d9-4386-8c94-f00b1b288135 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:03.832817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 589/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:43:03 2022] GET /identity/v3/projects/4858370d2e264d0aa5d0dd20a9eb68e1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:03.839734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9b5a9-ac60-4867-872c-836fabd13e49 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:03.931679 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9b5a9-ac60-4867-872c-836fabd13e49 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:03.967564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa891776-d3f7-4101-ae37-eb050c87af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:03.968214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa891776-d3f7-4101-ae37-eb050c87af62 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:03.968491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa891776-d3f7-4101-ae37-eb050c87af62 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:03.968764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa891776-d3f7-4101-ae37-eb050c87af62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:03.969605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa891776-d3f7-4101-ae37-eb050c87af62 None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=4858370d2e264d0aa5d0dd20a9eb68e1, user.id=66438ca8ca85492aa1e3cf8bd2b3645f) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:43:03.969917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa891776-d3f7-4101-ae37-eb050c87af62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:03.971368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa891776-d3f7-4101-ae37-eb050c87af62 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:03.977597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 572/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:43:03 2022] GET /identity/v3/role_assignments?user.id=66438ca8ca85492aa1e3cf8bd2b3645f&scope.project.id=4858370d2e264d0aa5d0dd20a9eb68e1&role.id=c158bb1781c44a03890992161076b84b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:06.372361 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da62dba-f645-495d-889c-bf6bcf3ba44b None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:06.372917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da62dba-f645-495d-889c-bf6bcf3ba44b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:06.372917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da62dba-f645-495d-889c-bf6bcf3ba44b None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:06.374278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 590/1162] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:43:06.379357 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7cc9-b95c-4bcf-9f2b-6caab71a2243 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:06.379769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7cc9-b95c-4bcf-9f2b-6caab71a2243 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:06.379910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d7cc9-b95c-4bcf-9f2b-6caab71a2243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:06.396617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d36d7cc9-b95c-4bcf-9f2b-6caab71a2243 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:43:06.397830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d36d7cc9-b95c-4bcf-9f2b-6caab71a2243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:43:06.460197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 573/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:43:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:43:06.482620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da62dba-f645-495d-889c-bf6bcf3ba44b None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:06.587580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da62dba-f645-495d-889c-bf6bcf3ba44b None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:06.619973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365db2fc-30e2-4090-b971-1b087f3f7417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:06.620601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db2fc-30e2-4090-b971-1b087f3f7417 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:06.620877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db2fc-30e2-4090-b971-1b087f3f7417 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:06.621146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365db2fc-30e2-4090-b971-1b087f3f7417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:06.684082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365db2fc-30e2-4090-b971-1b087f3f7417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:06.685542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365db2fc-30e2-4090-b971-1b087f3f7417 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:06.781032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 591/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:43:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:43:06.788363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7cc9-b95c-4bcf-9f2b-6caab71a2243 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:06.881727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d7cc9-b95c-4bcf-9f2b-6caab71a2243 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:06.912982 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0568a1da-8237-4dee-bba9-56080df8c148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:06.913795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568a1da-8237-4dee-bba9-56080df8c148 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:06.914076 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568a1da-8237-4dee-bba9-56080df8c148 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:06.914935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0568a1da-8237-4dee-bba9-56080df8c148 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:06.921346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568a1da-8237-4dee-bba9-56080df8c148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:06.922828 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0568a1da-8237-4dee-bba9-56080df8c148 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:06.936003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-0568a1da-8237-4dee-bba9-56080df8c148 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 06 12:43:06.937170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 574/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Apr 6 12:43:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:43:06.943320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365db2fc-30e2-4090-b971-1b087f3f7417 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:07.036087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365db2fc-30e2-4090-b971-1b087f3f7417 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:07.068755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ad79-861c-4e6b-adaf-803bba0b3fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:07.069409 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ad79-861c-4e6b-adaf-803bba0b3fc5 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:07.069719 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ad79-861c-4e6b-adaf-803bba0b3fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:07.069991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ad79-861c-4e6b-adaf-803bba0b3fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:07.071223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ad79-861c-4e6b-adaf-803bba0b3fc5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:43:07.071528 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ad79-861c-4e6b-adaf-803bba0b3fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:07.072906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ad79-861c-4e6b-adaf-803bba0b3fc5 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:07.079876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 592/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Wed Apr 6 12:43:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:09.333354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30935c-f662-4e17-96c9-d6843c3cbbe1 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:09.333835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30935c-f662-4e17-96c9-d6843c3cbbe1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:09.333927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30935c-f662-4e17-96c9-d6843c3cbbe1 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:09.335300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 575/1167] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:43:09.340931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0ddad-82db-4bbb-a907-0b5b0b9f866a None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:09.341346 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0ddad-82db-4bbb-a907-0b5b0b9f866a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:09.341478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0ddad-82db-4bbb-a907-0b5b0b9f866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:09.357639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e8d0ddad-82db-4bbb-a907-0b5b0b9f866a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:43:09.358816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e8d0ddad-82db-4bbb-a907-0b5b0b9f866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:43:09.420573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 593/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:43:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:43:09.444742 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30935c-f662-4e17-96c9-d6843c3cbbe1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:09.544035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30935c-f662-4e17-96c9-d6843c3cbbe1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:09.577055 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dced8-eca6-4d0d-b94b-f578b289e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:09.577740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dced8-eca6-4d0d-b94b-f578b289e513 None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:09.578026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dced8-eca6-4d0d-b94b-f578b289e513 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:09.578306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dced8-eca6-4d0d-b94b-f578b289e513 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:09.579050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dced8-eca6-4d0d-b94b-f578b289e513 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:09.580498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dced8-eca6-4d0d-b94b-f578b289e513 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:09.595016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 576/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Wed Apr 6 12:43:09 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:43:11.920049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b680a-0161-49e2-b731-1053c286cdbc None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:11.920609 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b680a-0161-49e2-b731-1053c286cdbc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:11.920609 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b680a-0161-49e2-b731-1053c286cdbc None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:11.921974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 594/1170] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:43:11.927309 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32f010-63ad-4edc-8b54-d58927be2cf1 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:11.927694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32f010-63ad-4edc-8b54-d58927be2cf1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:11.927897 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32f010-63ad-4edc-8b54-d58927be2cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:11.944857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-0a32f010-63ad-4edc-8b54-d58927be2cf1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:43:11.946779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0a32f010-63ad-4edc-8b54-d58927be2cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:43:12.007483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 577/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:43:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:43:12.032613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b680a-0161-49e2-b731-1053c286cdbc None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:12.127597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b680a-0161-49e2-b731-1053c286cdbc None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:12.159511 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf396a-80bd-4507-8748-ad38b0a46278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:12.160351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf396a-80bd-4507-8748-ad38b0a46278 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:12.160632 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf396a-80bd-4507-8748-ad38b0a46278 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:12.160904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf396a-80bd-4507-8748-ad38b0a46278 None admin] PATH_INFO: `/v3/domains/080679b44ace48268607424a379a81c3` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:12.170885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf396a-80bd-4507-8748-ad38b0a46278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=080679b44ace48268607424a379a81c3)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:12.172274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf396a-80bd-4507-8748-ad38b0a46278 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:12.174175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 595/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Wed Apr 6 12:43:12 2022] GET /identity/v3/domains/080679b44ace48268607424a379a81c3 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:12.180523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32f010-63ad-4edc-8b54-d58927be2cf1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:12.271966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32f010-63ad-4edc-8b54-d58927be2cf1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:12.302968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb9f5d-b9c1-4a65-b7e4-a7ee113e25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:12.303619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9f5d-b9c1-4a65-b7e4-a7ee113e25be None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:12.303901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9f5d-b9c1-4a65-b7e4-a7ee113e25be None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:12.304176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb9f5d-b9c1-4a65-b7e4-a7ee113e25be None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:12.305394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb9f5d-b9c1-4a65-b7e4-a7ee113e25be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:12.307007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb9f5d-b9c1-4a65-b7e4-a7ee113e25be None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:12.332364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 578/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:43:12 2022] POST /identity/v3/projects => generated 361 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:43:14.704988 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de15262-a3b2-4715-8062-7cfa0a28caae None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:14.705493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de15262-a3b2-4715-8062-7cfa0a28caae None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:14.705493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de15262-a3b2-4715-8062-7cfa0a28caae None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:14.706833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 596/1174] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:43:14.712990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54696a8-e4b0-4f54-bc69-850e6278d8b1 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:14.713449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54696a8-e4b0-4f54-bc69-850e6278d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:14.713544 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54696a8-e4b0-4f54-bc69-850e6278d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:14.729745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c54696a8-e4b0-4f54-bc69-850e6278d8b1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:43:14.730930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c54696a8-e4b0-4f54-bc69-850e6278d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:43:14.794006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 579/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:43:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:43:14.820828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de15262-a3b2-4715-8062-7cfa0a28caae None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:14.921166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de15262-a3b2-4715-8062-7cfa0a28caae None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:14.953468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4addf-e510-4b2f-a1a7-375717076944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:14.954352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4addf-e510-4b2f-a1a7-375717076944 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:14.954634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4addf-e510-4b2f-a1a7-375717076944 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:14.954907 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4addf-e510-4b2f-a1a7-375717076944 None admin] PATH_INFO: `/v3/domains/080679b44ace48268607424a379a81c3` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:14.956121 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4addf-e510-4b2f-a1a7-375717076944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=080679b44ace48268607424a379a81c3)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:14.957495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4addf-e510-4b2f-a1a7-375717076944 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:14.959127 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 597/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Wed Apr 6 12:43:14 2022] GET /identity/v3/domains/080679b44ace48268607424a379a81c3 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:14.965363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54696a8-e4b0-4f54-bc69-850e6278d8b1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:15.063229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54696a8-e4b0-4f54-bc69-850e6278d8b1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:15.095519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc44db3-ed21-46c4-b307-2a3ca800a3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:15.096185 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc44db3-ed21-46c4-b307-2a3ca800a3de None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:15.096470 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc44db3-ed21-46c4-b307-2a3ca800a3de None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:15.096744 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc44db3-ed21-46c4-b307-2a3ca800a3de None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:15.097449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc44db3-ed21-46c4-b307-2a3ca800a3de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:15.099013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc44db3-ed21-46c4-b307-2a3ca800a3de None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:15.119024 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 580/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:43:14 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:43:17.456998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb14b-0dd1-4ff8-b818-14cefc839b11 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:17.457519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb14b-0dd1-4ff8-b818-14cefc839b11 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:17.457519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fb14b-0dd1-4ff8-b818-14cefc839b11 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:17.458912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 598/1178] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:43:17.464072 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc430db-569a-472d-b160-73110fb0f498 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:17.464490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc430db-569a-472d-b160-73110fb0f498 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:17.464622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc430db-569a-472d-b160-73110fb0f498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:17.480891 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-2fc430db-569a-472d-b160-73110fb0f498 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:43:17.482107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2fc430db-569a-472d-b160-73110fb0f498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:43:17.547226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 581/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:43:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:43:17.573561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fb14b-0dd1-4ff8-b818-14cefc839b11 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:17.675245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fb14b-0dd1-4ff8-b818-14cefc839b11 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:17.708611 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ca58a-e2bd-499d-be58-ec16cab11b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:17.709393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ca58a-e2bd-499d-be58-ec16cab11b71 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:17.709704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ca58a-e2bd-499d-be58-ec16cab11b71 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:17.709985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ca58a-e2bd-499d-be58-ec16cab11b71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:17.720148 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ca58a-e2bd-499d-be58-ec16cab11b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:43:17.727664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-a71ca58a-e2bd-499d-be58-ec16cab11b71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:43:17.728871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 599/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:43:17.735322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc430db-569a-472d-b160-73110fb0f498 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:17.829809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc430db-569a-472d-b160-73110fb0f498 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:17.862420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee16ab-61b3-4b0a-9703-6d88183fba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:17.863081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee16ab-61b3-4b0a-9703-6d88183fba6b None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:17.863369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee16ab-61b3-4b0a-9703-6d88183fba6b None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:17.863648 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee16ab-61b3-4b0a-9703-6d88183fba6b None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:17.864389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee16ab-61b3-4b0a-9703-6d88183fba6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:43:17.864695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee16ab-61b3-4b0a-9703-6d88183fba6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:17.866134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee16ab-61b3-4b0a-9703-6d88183fba6b None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:17.875132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 582/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:17.880976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ca58a-e2bd-499d-be58-ec16cab11b71 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:17.974999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ca58a-e2bd-499d-be58-ec16cab11b71 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:18.006944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f97a2-6944-43fc-91ba-129e0475b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:18.007836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f97a2-6944-43fc-91ba-129e0475b78d None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:18.008114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f97a2-6944-43fc-91ba-129e0475b78d None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:18.008380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f97a2-6944-43fc-91ba-129e0475b78d None admin] PATH_INFO: `/v3/users/2a13b153e80e42c68a72afbd2c10c24f` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:18.021052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f97a2-6944-43fc-91ba-129e0475b78d None admin] RBAC: Authorizing `identity:get_user(user_id=2a13b153e80e42c68a72afbd2c10c24f)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:18.022530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f97a2-6944-43fc-91ba-129e0475b78d None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:18.024715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 600/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:43:17 2022] GET /identity/v3/users/2a13b153e80e42c68a72afbd2c10c24f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:18.030593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee16ab-61b3-4b0a-9703-6d88183fba6b None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:18.127371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee16ab-61b3-4b0a-9703-6d88183fba6b None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:18.158878 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1657aae-349a-4f7e-8a21-c59977e737c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:18.159516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657aae-349a-4f7e-8a21-c59977e737c8 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:18.159795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657aae-349a-4f7e-8a21-c59977e737c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:18.160065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657aae-349a-4f7e-8a21-c59977e737c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:18.222827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1657aae-349a-4f7e-8a21-c59977e737c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:18.224297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1657aae-349a-4f7e-8a21-c59977e737c8 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:18.315307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 583/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:43:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:43:18.321823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f97a2-6944-43fc-91ba-129e0475b78d None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:18.416575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f97a2-6944-43fc-91ba-129e0475b78d None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:18.449382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4bb71-904e-4215-b3c1-5b827cc84efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:18.450256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4bb71-904e-4215-b3c1-5b827cc84efd None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:18.450538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4bb71-904e-4215-b3c1-5b827cc84efd None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:18.450811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4bb71-904e-4215-b3c1-5b827cc84efd None admin] PATH_INFO: `/v3/projects/d44bbb0d9f124d03909c81edc066b7a5` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:18.451968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4bb71-904e-4215-b3c1-5b827cc84efd None admin] RBAC: Authorizing `identity:get_project(project_id=d44bbb0d9f124d03909c81edc066b7a5)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:18.453401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4bb71-904e-4215-b3c1-5b827cc84efd None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:18.455120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 601/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:43:18 2022] GET /identity/v3/projects/d44bbb0d9f124d03909c81edc066b7a5 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:18.462127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1657aae-349a-4f7e-8a21-c59977e737c8 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:18.553592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1657aae-349a-4f7e-8a21-c59977e737c8 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:18.599513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57bfd3-5dae-4309-a6ce-451ab5d29177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:18.600381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57bfd3-5dae-4309-a6ce-451ab5d29177 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:18.600824 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57bfd3-5dae-4309-a6ce-451ab5d29177 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:18.601344 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57bfd3-5dae-4309-a6ce-451ab5d29177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:18.602448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57bfd3-5dae-4309-a6ce-451ab5d29177 None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=d44bbb0d9f124d03909c81edc066b7a5, user.id=2a13b153e80e42c68a72afbd2c10c24f) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:43:18.602756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57bfd3-5dae-4309-a6ce-451ab5d29177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:18.604243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57bfd3-5dae-4309-a6ce-451ab5d29177 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:18.611654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 584/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:43:18 2022] GET /identity/v3/role_assignments?user.id=2a13b153e80e42c68a72afbd2c10c24f&scope.project.id=d44bbb0d9f124d03909c81edc066b7a5&role.id=c158bb1781c44a03890992161076b84b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:20.916569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496dfc-4b8f-4426-9b48-48941ba54068 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:20.917135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496dfc-4b8f-4426-9b48-48941ba54068 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:20.917135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496dfc-4b8f-4426-9b48-48941ba54068 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:20.918516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 602/1186] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:43:20.924207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca653e-2193-486c-b360-fbf8bac1d4c5 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:20.924658 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca653e-2193-486c-b360-fbf8bac1d4c5 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:20.924751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca653e-2193-486c-b360-fbf8bac1d4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:20.941023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d4ca653e-2193-486c-b360-fbf8bac1d4c5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:43:20.942220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d4ca653e-2193-486c-b360-fbf8bac1d4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:43:21.009239 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 585/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:43:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:43:21.032324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a496dfc-4b8f-4426-9b48-48941ba54068 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:21.129625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a496dfc-4b8f-4426-9b48-48941ba54068 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:21.161474 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc88a64-987b-4fbf-9dfe-d6aebbe27128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:21.162281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc88a64-987b-4fbf-9dfe-d6aebbe27128 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:21.162564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc88a64-987b-4fbf-9dfe-d6aebbe27128 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:21.162836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc88a64-987b-4fbf-9dfe-d6aebbe27128 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:21.173295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc88a64-987b-4fbf-9dfe-d6aebbe27128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:43:21.180261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-efc88a64-987b-4fbf-9dfe-d6aebbe27128 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:43:21.181456 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 603/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:43:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:43:21.188854 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca653e-2193-486c-b360-fbf8bac1d4c5 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:21.281111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca653e-2193-486c-b360-fbf8bac1d4c5 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:21.312807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a6670-c235-42d9-8c52-a106f28fad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:21.313459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6670-c235-42d9-8c52-a106f28fad97 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:21.313766 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6670-c235-42d9-8c52-a106f28fad97 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:21.314035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6670-c235-42d9-8c52-a106f28fad97 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:21.314772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a6670-c235-42d9-8c52-a106f28fad97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:43:21.315071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a6670-c235-42d9-8c52-a106f28fad97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:21.316447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a6670-c235-42d9-8c52-a106f28fad97 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:21.325278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 586/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:21.331149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc88a64-987b-4fbf-9dfe-d6aebbe27128 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:21.427672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc88a64-987b-4fbf-9dfe-d6aebbe27128 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:21.459218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fa2a5-15ed-4f44-b0d2-d91908b0fbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:21.460080 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fa2a5-15ed-4f44-b0d2-d91908b0fbd0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:21.460980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fa2a5-15ed-4f44-b0d2-d91908b0fbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:21.461287 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fa2a5-15ed-4f44-b0d2-d91908b0fbd0 None admin] PATH_INFO: `/v3/users/2a13b153e80e42c68a72afbd2c10c24f` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:21.462743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fa2a5-15ed-4f44-b0d2-d91908b0fbd0 None admin] RBAC: Authorizing `identity:get_user(user_id=2a13b153e80e42c68a72afbd2c10c24f)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:21.464179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fa2a5-15ed-4f44-b0d2-d91908b0fbd0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:21.465825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 604/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:43:21 2022] GET /identity/v3/users/2a13b153e80e42c68a72afbd2c10c24f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:21.471584 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a6670-c235-42d9-8c52-a106f28fad97 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:21.569235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a6670-c235-42d9-8c52-a106f28fad97 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:21.603557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3ae37-91a3-413c-9f98-408aa087f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:21.604419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3ae37-91a3-413c-9f98-408aa087f32f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:21.604698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3ae37-91a3-413c-9f98-408aa087f32f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:21.604969 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3ae37-91a3-413c-9f98-408aa087f32f None admin] PATH_INFO: `/v3/projects/d44bbb0d9f124d03909c81edc066b7a5` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:21.606166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3ae37-91a3-413c-9f98-408aa087f32f None admin] RBAC: Authorizing `identity:get_project(project_id=d44bbb0d9f124d03909c81edc066b7a5)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:21.607626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3ae37-91a3-413c-9f98-408aa087f32f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:21.609328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 587/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:43:21 2022] GET /identity/v3/projects/d44bbb0d9f124d03909c81edc066b7a5 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:21.615384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fa2a5-15ed-4f44-b0d2-d91908b0fbd0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:21.709467 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fa2a5-15ed-4f44-b0d2-d91908b0fbd0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:21.740579 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b195c4a-a296-49f3-9614-dd8dae7e8890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:21.741449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195c4a-a296-49f3-9614-dd8dae7e8890 None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:21.742384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195c4a-a296-49f3-9614-dd8dae7e8890 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:21.742661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b195c4a-a296-49f3-9614-dd8dae7e8890 None admin] PATH_INFO: `/v3/projects/d44bbb0d9f124d03909c81edc066b7a5/users/2a13b153e80e42c68a72afbd2c10c24f/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:21.744567 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b195c4a-a296-49f3-9614-dd8dae7e8890 None admin] RBAC: Authorizing `identity:create_grant(project_id=d44bbb0d9f124d03909c81edc066b7a5, user_id=2a13b153e80e42c68a72afbd2c10c24f, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:21.746043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b195c4a-a296-49f3-9614-dd8dae7e8890 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:21.758673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 605/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:43:21 2022] PUT /identity/v3/projects/d44bbb0d9f124d03909c81edc066b7a5/users/2a13b153e80e42c68a72afbd2c10c24f/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:43:24.041263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e42aa-face-4c18-905f-6965f7ad251a None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:24.041845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e42aa-face-4c18-905f-6965f7ad251a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:24.042238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e42aa-face-4c18-905f-6965f7ad251a None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:24.044528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 588/1193] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:43:24.051878 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369e9c2-211d-455b-9532-917bb86d703c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:24.052372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369e9c2-211d-455b-9532-917bb86d703c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:24.052482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369e9c2-211d-455b-9532-917bb86d703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:24.069444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d369e9c2-211d-455b-9532-917bb86d703c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:43:24.070749 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d369e9c2-211d-455b-9532-917bb86d703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:43:24.135140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 606/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:43:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:43:24.160992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e42aa-face-4c18-905f-6965f7ad251a None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:24.262274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e42aa-face-4c18-905f-6965f7ad251a None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:24.296590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97856bc-cb66-4058-9a36-7c6d003b0f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:24.297294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97856bc-cb66-4058-9a36-7c6d003b0f5a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:24.297603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97856bc-cb66-4058-9a36-7c6d003b0f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:24.297887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97856bc-cb66-4058-9a36-7c6d003b0f5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:24.308651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97856bc-cb66-4058-9a36-7c6d003b0f5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:43:24.315571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-f97856bc-cb66-4058-9a36-7c6d003b0f5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:43:24.316783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 589/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:43:24.324116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369e9c2-211d-455b-9532-917bb86d703c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:24.420642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369e9c2-211d-455b-9532-917bb86d703c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:24.454791 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcde00d-e853-49fb-ab1f-31a28e426e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:24.455453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcde00d-e853-49fb-ab1f-31a28e426e29 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:24.455733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcde00d-e853-49fb-ab1f-31a28e426e29 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:24.456004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcde00d-e853-49fb-ab1f-31a28e426e29 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:24.456750 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcde00d-e853-49fb-ab1f-31a28e426e29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:43:24.457053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcde00d-e853-49fb-ab1f-31a28e426e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:24.458481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcde00d-e853-49fb-ab1f-31a28e426e29 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:24.466860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 607/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:24.473004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97856bc-cb66-4058-9a36-7c6d003b0f5a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:24.568525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97856bc-cb66-4058-9a36-7c6d003b0f5a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:24.603448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdf0c5-38d3-4138-a71a-5adcac6087ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:24.604457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf0c5-38d3-4138-a71a-5adcac6087ad None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:24.604800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf0c5-38d3-4138-a71a-5adcac6087ad None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:24.605095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdf0c5-38d3-4138-a71a-5adcac6087ad None admin] PATH_INFO: `/v3/users/2a13b153e80e42c68a72afbd2c10c24f` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:24.606465 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdf0c5-38d3-4138-a71a-5adcac6087ad None admin] RBAC: Authorizing `identity:get_user(user_id=2a13b153e80e42c68a72afbd2c10c24f)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:24.608082 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cdf0c5-38d3-4138-a71a-5adcac6087ad None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:24.609901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 590/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Wed Apr 6 12:43:24 2022] GET /identity/v3/users/2a13b153e80e42c68a72afbd2c10c24f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:24.615630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcde00d-e853-49fb-ab1f-31a28e426e29 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:24.711946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcde00d-e853-49fb-ab1f-31a28e426e29 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:24.744622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2637863-8ad4-47cf-97cf-03bcfb9ea44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:24.745262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2637863-8ad4-47cf-97cf-03bcfb9ea44e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:24.745543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2637863-8ad4-47cf-97cf-03bcfb9ea44e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:24.745848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2637863-8ad4-47cf-97cf-03bcfb9ea44e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:24.810629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2637863-8ad4-47cf-97cf-03bcfb9ea44e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:24.812077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2637863-8ad4-47cf-97cf-03bcfb9ea44e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:24.904790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 608/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:43:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:43:24.910645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdf0c5-38d3-4138-a71a-5adcac6087ad None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:25.004160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdf0c5-38d3-4138-a71a-5adcac6087ad None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:25.035688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d266a1-0d63-42d3-92d9-35f4336207a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:25.036561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d266a1-0d63-42d3-92d9-35f4336207a2 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:25.036841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d266a1-0d63-42d3-92d9-35f4336207a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:25.037116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d266a1-0d63-42d3-92d9-35f4336207a2 None admin] PATH_INFO: `/v3/projects/d44bbb0d9f124d03909c81edc066b7a5` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:25.038318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d266a1-0d63-42d3-92d9-35f4336207a2 None admin] RBAC: Authorizing `identity:get_project(project_id=d44bbb0d9f124d03909c81edc066b7a5)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:25.039824 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d266a1-0d63-42d3-92d9-35f4336207a2 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:25.041506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 591/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Wed Apr 6 12:43:24 2022] GET /identity/v3/projects/d44bbb0d9f124d03909c81edc066b7a5 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:43:25.047664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2637863-8ad4-47cf-97cf-03bcfb9ea44e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:43:25.141049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2637863-8ad4-47cf-97cf-03bcfb9ea44e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:43:25.173746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ad3fd-b4e3-45f2-b48c-9a6cdb9b4c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:43:25.174320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ad3fd-b4e3-45f2-b48c-9a6cdb9b4c07 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:43:25.174600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ad3fd-b4e3-45f2-b48c-9a6cdb9b4c07 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:43:25.174868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ad3fd-b4e3-45f2-b48c-9a6cdb9b4c07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:43:25.175684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ad3fd-b4e3-45f2-b48c-9a6cdb9b4c07 None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=d44bbb0d9f124d03909c81edc066b7a5, user.id=2a13b153e80e42c68a72afbd2c10c24f) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:43:25.175992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ad3fd-b4e3-45f2-b48c-9a6cdb9b4c07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:43:25.177424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ad3fd-b4e3-45f2-b48c-9a6cdb9b4c07 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:43:25.184158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 609/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:43:25 2022] GET /identity/v3/role_assignments?user.id=2a13b153e80e42c68a72afbd2c10c24f&scope.project.id=d44bbb0d9f124d03909c81edc066b7a5&role.id=c158bb1781c44a03890992161076b84b => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:28.611033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ad8a-c1ba-4fa9-b73b-30cbb520f77e None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:28.611033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ad8a-c1ba-4fa9-b73b-30cbb520f77e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:28.611033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695ad8a-c1ba-4fa9-b73b-30cbb520f77e None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:28.612306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 592/1201] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:44:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:44:28.616689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65799a4d-2045-40b6-8488-41102747f312 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:28.617181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65799a4d-2045-40b6-8488-41102747f312 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:28.617369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65799a4d-2045-40b6-8488-41102747f312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:28.638460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-65799a4d-2045-40b6-8488-41102747f312 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:44:28.639744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-65799a4d-2045-40b6-8488-41102747f312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:44:28.725796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 610/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:44:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:44:28.745305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695ad8a-c1ba-4fa9-b73b-30cbb520f77e None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:28.889105 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695ad8a-c1ba-4fa9-b73b-30cbb520f77e None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:28.936788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4f572-c629-457e-a469-33d9815002cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:28.936788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4f572-c629-457e-a469-33d9815002cf None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:28.936788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4f572-c629-457e-a469-33d9815002cf None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:28.936788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4f572-c629-457e-a469-33d9815002cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:28.948239 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4f572-c629-457e-a469-33d9815002cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:28.949882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4f572-c629-457e-a469-33d9815002cf None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:28.967665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-2ef4f572-c629-457e-a469-33d9815002cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:28.974463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 593/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:28.975212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65799a4d-2045-40b6-8488-41102747f312 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:29.086438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65799a4d-2045-40b6-8488-41102747f312 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:29.127638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf5405-523a-4318-abf6-180ae69ac4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:29.128319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5405-523a-4318-abf6-180ae69ac4cf None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:29.128598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5405-523a-4318-abf6-180ae69ac4cf None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:29.129369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf5405-523a-4318-abf6-180ae69ac4cf None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:29.130214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf5405-523a-4318-abf6-180ae69ac4cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:29.130521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf5405-523a-4318-abf6-180ae69ac4cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:29.131943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf5405-523a-4318-abf6-180ae69ac4cf None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:29.149999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 611/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:44:29.151220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4f572-c629-457e-a469-33d9815002cf None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:29.272415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4f572-c629-457e-a469-33d9815002cf None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:29.315724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e754270-871b-4c57-9877-6f93893411fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:29.317028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e754270-871b-4c57-9877-6f93893411fc None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:29.317398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e754270-871b-4c57-9877-6f93893411fc None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:29.317635 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e754270-871b-4c57-9877-6f93893411fc None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:29.318346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e754270-871b-4c57-9877-6f93893411fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:29.319819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e754270-871b-4c57-9877-6f93893411fc None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:29.345318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 594/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Wed Apr 6 12:44:29 2022] POST /identity/v3/users => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:44:31.792919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65fef3-6d15-4ef0-b542-4c424536dfd5 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:31.793507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65fef3-6d15-4ef0-b542-4c424536dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:31.793507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65fef3-6d15-4ef0-b542-4c424536dfd5 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:31.794865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 612/1206] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:44:31.803944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaadbf-4539-4bde-9e3a-4747e1d63d40 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:31.804507 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaadbf-4539-4bde-9e3a-4747e1d63d40 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:31.804507 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaadbf-4539-4bde-9e3a-4747e1d63d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:31.823928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-dbcaadbf-4539-4bde-9e3a-4747e1d63d40 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:44:31.825717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-dbcaadbf-4539-4bde-9e3a-4747e1d63d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:44:31.899248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 595/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:44:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:44:31.927258 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65fef3-6d15-4ef0-b542-4c424536dfd5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:32.037821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65fef3-6d15-4ef0-b542-4c424536dfd5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:32.077680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7adb89-75a6-41f6-b86e-479d2b958db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:32.078739 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7adb89-75a6-41f6-b86e-479d2b958db0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:32.079178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7adb89-75a6-41f6-b86e-479d2b958db0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:32.079628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7adb89-75a6-41f6-b86e-479d2b958db0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:32.091922 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7adb89-75a6-41f6-b86e-479d2b958db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:44:32.099699 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-9a7adb89-75a6-41f6-b86e-479d2b958db0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:44:32.100940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 613/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:44:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:32.107293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaadbf-4539-4bde-9e3a-4747e1d63d40 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:32.226593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaadbf-4539-4bde-9e3a-4747e1d63d40 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:32.263824 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62ff3e-6690-4851-b9ca-a5cb0fe0d557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:32.264720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ff3e-6690-4851-b9ca-a5cb0fe0d557 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:32.265051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ff3e-6690-4851-b9ca-a5cb0fe0d557 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:32.265360 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ff3e-6690-4851-b9ca-a5cb0fe0d557 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:32.266303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62ff3e-6690-4851-b9ca-a5cb0fe0d557 None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:32.266648 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62ff3e-6690-4851-b9ca-a5cb0fe0d557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:32.268586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62ff3e-6690-4851-b9ca-a5cb0fe0d557 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:32.284152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 596/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:32.286831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7adb89-75a6-41f6-b86e-479d2b958db0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:32.401171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7adb89-75a6-41f6-b86e-479d2b958db0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:32.440360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956c7a6-d896-43b8-975b-60011c32e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:32.441150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c7a6-d896-43b8-975b-60011c32e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:32.441503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c7a6-d896-43b8-975b-60011c32e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:32.441972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956c7a6-d896-43b8-975b-60011c32e2d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:32.453260 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956c7a6-d896-43b8-975b-60011c32e2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:32.454848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956c7a6-d896-43b8-975b-60011c32e2d8 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:32.475198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-8956c7a6-d896-43b8-975b-60011c32e2d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:32.477089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 614/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:32.484578 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62ff3e-6690-4851-b9ca-a5cb0fe0d557 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:32.598326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62ff3e-6690-4851-b9ca-a5cb0fe0d557 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:32.635658 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4055-6be3-4fe7-988f-ac91fc129862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:32.636431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4055-6be3-4fe7-988f-ac91fc129862 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:32.636752 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4055-6be3-4fe7-988f-ac91fc129862 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:32.637027 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4055-6be3-4fe7-988f-ac91fc129862 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:32.637962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4055-6be3-4fe7-988f-ac91fc129862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:32.638266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4055-6be3-4fe7-988f-ac91fc129862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:32.639806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4055-6be3-4fe7-988f-ac91fc129862 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:32.653592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 597/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:32.659856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956c7a6-d896-43b8-975b-60011c32e2d8 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:32.775157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956c7a6-d896-43b8-975b-60011c32e2d8 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:32.813825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b36c1b-5402-42a8-a6fe-9689b83ec3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:32.815375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b36c1b-5402-42a8-a6fe-9689b83ec3fa None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:32.815831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b36c1b-5402-42a8-a6fe-9689b83ec3fa None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:32.816943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b36c1b-5402-42a8-a6fe-9689b83ec3fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:32.825647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b36c1b-5402-42a8-a6fe-9689b83ec3fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:32.827500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b36c1b-5402-42a8-a6fe-9689b83ec3fa None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:32.843940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-99b36c1b-5402-42a8-a6fe-9689b83ec3fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 12:44:32.845433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 615/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:32.851089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4055-6be3-4fe7-988f-ac91fc129862 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:32.969035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4055-6be3-4fe7-988f-ac91fc129862 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:33.010170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932c367-8f6f-4db8-9201-e95528b7e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:33.010913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932c367-8f6f-4db8-9201-e95528b7e62f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:33.011194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932c367-8f6f-4db8-9201-e95528b7e62f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:33.011463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a932c367-8f6f-4db8-9201-e95528b7e62f None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:33.012321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932c367-8f6f-4db8-9201-e95528b7e62f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:33.012678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932c367-8f6f-4db8-9201-e95528b7e62f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:33.014129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a932c367-8f6f-4db8-9201-e95528b7e62f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:33.034425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 598/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Apr 6 12:44:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:33.041021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b36c1b-5402-42a8-a6fe-9689b83ec3fa None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:33.162586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b36c1b-5402-42a8-a6fe-9689b83ec3fa None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:33.201136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76ea50-d4e2-46be-af03-6ffa9a7e267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:33.201989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76ea50-d4e2-46be-af03-6ffa9a7e267e None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:33.202365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76ea50-d4e2-46be-af03-6ffa9a7e267e None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:33.202776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76ea50-d4e2-46be-af03-6ffa9a7e267e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:33.275105 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76ea50-d4e2-46be-af03-6ffa9a7e267e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:33.276690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76ea50-d4e2-46be-af03-6ffa9a7e267e None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:33.384390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 616/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:44:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:44:33.390086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932c367-8f6f-4db8-9201-e95528b7e62f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:33.491095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a932c367-8f6f-4db8-9201-e95528b7e62f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:33.528866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74673e64-8029-4d08-8580-fda21e0cd5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:33.529933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74673e64-8029-4d08-8580-fda21e0cd5c5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:33.530307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74673e64-8029-4d08-8580-fda21e0cd5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:33.530684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74673e64-8029-4d08-8580-fda21e0cd5c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:33.541374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74673e64-8029-4d08-8580-fda21e0cd5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:33.542972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74673e64-8029-4d08-8580-fda21e0cd5c5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:33.561025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-74673e64-8029-4d08-8580-fda21e0cd5c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:33.562252 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 599/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:44:33.568396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76ea50-d4e2-46be-af03-6ffa9a7e267e None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:33.677592 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76ea50-d4e2-46be-af03-6ffa9a7e267e None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:33.719690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23b349-e848-47d2-9be8-6ed778f81405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:33.720544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b349-e848-47d2-9be8-6ed778f81405 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:33.720885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b349-e848-47d2-9be8-6ed778f81405 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:33.721249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23b349-e848-47d2-9be8-6ed778f81405 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:33.722106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23b349-e848-47d2-9be8-6ed778f81405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:33.723156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23b349-e848-47d2-9be8-6ed778f81405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:33.724648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23b349-e848-47d2-9be8-6ed778f81405 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:33.737025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 617/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:33.743006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74673e64-8029-4d08-8580-fda21e0cd5c5 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:33.855667 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74673e64-8029-4d08-8580-fda21e0cd5c5 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:33.897591 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2ae66-9969-491b-896a-b704723251d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:33.898605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ae66-9969-491b-896a-b704723251d5 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:33.898979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ae66-9969-491b-896a-b704723251d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:33.899256 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ae66-9969-491b-896a-b704723251d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:33.906526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2ae66-9969-491b-896a-b704723251d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:33.908050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2ae66-9969-491b-896a-b704723251d5 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:33.924535 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-27b2ae66-9969-491b-896a-b704723251d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:44:33.930661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 600/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:33.931874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23b349-e848-47d2-9be8-6ed778f81405 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:34.045169 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23b349-e848-47d2-9be8-6ed778f81405 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:34.095313 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bc96f-b762-41f4-bad9-4536d70a1aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:34.096503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc96f-b762-41f4-bad9-4536d70a1aee None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:34.097089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc96f-b762-41f4-bad9-4536d70a1aee None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:34.097594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bc96f-b762-41f4-bad9-4536d70a1aee None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:34.099082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bc96f-b762-41f4-bad9-4536d70a1aee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:34.099866 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bc96f-b762-41f4-bad9-4536d70a1aee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:34.102337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bc96f-b762-41f4-bad9-4536d70a1aee None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:34.121149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 618/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:34.127477 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2ae66-9969-491b-896a-b704723251d5 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:34.241667 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2ae66-9969-491b-896a-b704723251d5 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:34.290447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346532d4-e032-43d3-ab07-d82def9de9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:34.291478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346532d4-e032-43d3-ab07-d82def9de9dd None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:34.292067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346532d4-e032-43d3-ab07-d82def9de9dd None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:34.292430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346532d4-e032-43d3-ab07-d82def9de9dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:34.293805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346532d4-e032-43d3-ab07-d82def9de9dd None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=221dab3ebc4f4c68b253729391e9c503) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:34.294253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346532d4-e032-43d3-ab07-d82def9de9dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:34.296315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346532d4-e032-43d3-ab07-d82def9de9dd None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:34.305665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 601/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:44:34 2022] GET /identity/v3/role_assignments?user.id=221dab3ebc4f4c68b253729391e9c503&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:36.759983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5d10-19a8-496a-b3da-3854b7dd3c79 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:36.760901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5d10-19a8-496a-b3da-3854b7dd3c79 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:36.761240 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e5d10-19a8-496a-b3da-3854b7dd3c79 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:36.763053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 619/1220] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:44:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:44:36.770579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d421601-3b36-4dce-9e44-95eed850d8f7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:36.771145 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d421601-3b36-4dce-9e44-95eed850d8f7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:36.771352 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d421601-3b36-4dce-9e44-95eed850d8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:36.790254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-8d421601-3b36-4dce-9e44-95eed850d8f7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:44:36.791429 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8d421601-3b36-4dce-9e44-95eed850d8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:44:36.865095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 602/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:44:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:44:36.890685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e5d10-19a8-496a-b3da-3854b7dd3c79 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:37.004306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e5d10-19a8-496a-b3da-3854b7dd3c79 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:37.044836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4e68a-ea2a-41e9-83ac-1685bbb58803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:37.045733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4e68a-ea2a-41e9-83ac-1685bbb58803 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:37.046042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4e68a-ea2a-41e9-83ac-1685bbb58803 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:37.046375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4e68a-ea2a-41e9-83ac-1685bbb58803 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:37.061620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4e68a-ea2a-41e9-83ac-1685bbb58803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:44:37.068958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-62c4e68a-ea2a-41e9-83ac-1685bbb58803 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:44:37.073604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 620/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:44:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:37.079093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d421601-3b36-4dce-9e44-95eed850d8f7 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:37.192879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d421601-3b36-4dce-9e44-95eed850d8f7 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:37.229628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313cbd5-4921-4930-8e17-f9a9f9117c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:37.230283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313cbd5-4921-4930-8e17-f9a9f9117c7e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:37.230584 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313cbd5-4921-4930-8e17-f9a9f9117c7e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:37.230865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313cbd5-4921-4930-8e17-f9a9f9117c7e None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:37.231633 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313cbd5-4921-4930-8e17-f9a9f9117c7e None admin] RBAC: Adding query filter params (name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:37.231941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313cbd5-4921-4930-8e17-f9a9f9117c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:37.233552 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313cbd5-4921-4930-8e17-f9a9f9117c7e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:37.243618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 603/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:44:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:37.255424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4e68a-ea2a-41e9-83ac-1685bbb58803 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:37.381850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4e68a-ea2a-41e9-83ac-1685bbb58803 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:37.422383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de69c78-19f6-4159-b4fb-c07497b7c6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:37.423336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de69c78-19f6-4159-b4fb-c07497b7c6e2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:37.423688 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de69c78-19f6-4159-b4fb-c07497b7c6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:37.424171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de69c78-19f6-4159-b4fb-c07497b7c6e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:37.438010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de69c78-19f6-4159-b4fb-c07497b7c6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:37.439549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de69c78-19f6-4159-b4fb-c07497b7c6e2 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:37.459042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-2de69c78-19f6-4159-b4fb-c07497b7c6e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:37.460623 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 621/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:37.466442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313cbd5-4921-4930-8e17-f9a9f9117c7e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:37.577038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313cbd5-4921-4930-8e17-f9a9f9117c7e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:37.621757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15594da7-a6c1-4868-8b50-4865a51a4f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:37.622841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15594da7-a6c1-4868-8b50-4865a51a4f15 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:37.624861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15594da7-a6c1-4868-8b50-4865a51a4f15 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:37.625894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15594da7-a6c1-4868-8b50-4865a51a4f15 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:37.626791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15594da7-a6c1-4868-8b50-4865a51a4f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:37.627166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15594da7-a6c1-4868-8b50-4865a51a4f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:37.629342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15594da7-a6c1-4868-8b50-4865a51a4f15 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:37.643327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 604/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:37.649711 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de69c78-19f6-4159-b4fb-c07497b7c6e2 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:37.754355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de69c78-19f6-4159-b4fb-c07497b7c6e2 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:37.787878 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4374a42-f29c-4e52-9f0a-3294d4653b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:37.788674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4374a42-f29c-4e52-9f0a-3294d4653b6f None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:37.788955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4374a42-f29c-4e52-9f0a-3294d4653b6f None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:37.789225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4374a42-f29c-4e52-9f0a-3294d4653b6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:37.796570 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4374a42-f29c-4e52-9f0a-3294d4653b6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:37.798284 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4374a42-f29c-4e52-9f0a-3294d4653b6f None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:37.812274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-b4374a42-f29c-4e52-9f0a-3294d4653b6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 12:44:37.813433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 622/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:44:37.820248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15594da7-a6c1-4868-8b50-4865a51a4f15 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:37.929940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15594da7-a6c1-4868-8b50-4865a51a4f15 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:37.976033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cd522-ca5d-4d0a-abec-da816fc90828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:37.976796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cd522-ca5d-4d0a-abec-da816fc90828 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:37.977115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cd522-ca5d-4d0a-abec-da816fc90828 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:37.977423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cd522-ca5d-4d0a-abec-da816fc90828 None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:37.978625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cd522-ca5d-4d0a-abec-da816fc90828 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:37.978840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cd522-ca5d-4d0a-abec-da816fc90828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:37.980515 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cd522-ca5d-4d0a-abec-da816fc90828 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:38.007403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 605/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Apr 6 12:44:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:38.013882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4374a42-f29c-4e52-9f0a-3294d4653b6f None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:38.137770 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4374a42-f29c-4e52-9f0a-3294d4653b6f None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:38.173686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1790e6-4249-4f0f-8e10-ff88856c01e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:38.174471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1790e6-4249-4f0f-8e10-ff88856c01e7 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:38.174752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1790e6-4249-4f0f-8e10-ff88856c01e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:38.175022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1790e6-4249-4f0f-8e10-ff88856c01e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:38.187294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1790e6-4249-4f0f-8e10-ff88856c01e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:38.188683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1790e6-4249-4f0f-8e10-ff88856c01e7 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:38.206045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-ad1790e6-4249-4f0f-8e10-ff88856c01e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:38.207915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 623/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:38.214314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cd522-ca5d-4d0a-abec-da816fc90828 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:38.340057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cd522-ca5d-4d0a-abec-da816fc90828 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:38.378464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b39d24-4d9b-4f70-bb81-bfb1227750c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:38.379886 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b39d24-4d9b-4f70-bb81-bfb1227750c3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:38.380252 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b39d24-4d9b-4f70-bb81-bfb1227750c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:38.380610 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b39d24-4d9b-4f70-bb81-bfb1227750c3 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:38.381433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b39d24-4d9b-4f70-bb81-bfb1227750c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:38.381845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b39d24-4d9b-4f70-bb81-bfb1227750c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:38.383326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b39d24-4d9b-4f70-bb81-bfb1227750c3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:38.398002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 606/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:38.403634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1790e6-4249-4f0f-8e10-ff88856c01e7 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:38.528124 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1790e6-4249-4f0f-8e10-ff88856c01e7 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:38.569055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596af7b-8c3c-46fa-a328-2f39b540b641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:38.570116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596af7b-8c3c-46fa-a328-2f39b540b641 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:38.570491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596af7b-8c3c-46fa-a328-2f39b540b641 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:38.570810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596af7b-8c3c-46fa-a328-2f39b540b641 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:38.578809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596af7b-8c3c-46fa-a328-2f39b540b641 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:38.580595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596af7b-8c3c-46fa-a328-2f39b540b641 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:38.598252 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-e596af7b-8c3c-46fa-a328-2f39b540b641 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:44:38.599715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 624/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:44:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:38.606326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b39d24-4d9b-4f70-bb81-bfb1227750c3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:38.721750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b39d24-4d9b-4f70-bb81-bfb1227750c3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:38.763101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a18b3b-2045-46e5-9674-69c70771998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:38.763820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a18b3b-2045-46e5-9674-69c70771998f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:38.764124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a18b3b-2045-46e5-9674-69c70771998f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:38.764429 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a18b3b-2045-46e5-9674-69c70771998f None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:38.765300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a18b3b-2045-46e5-9674-69c70771998f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:38.765671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a18b3b-2045-46e5-9674-69c70771998f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:38.767249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a18b3b-2045-46e5-9674-69c70771998f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:38.781200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 607/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:44:38.788213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596af7b-8c3c-46fa-a328-2f39b540b641 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:38.897107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596af7b-8c3c-46fa-a328-2f39b540b641 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:38.933419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766f408-c905-4047-ae7e-bbda92574219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:38.934485 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766f408-c905-4047-ae7e-bbda92574219 None admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:38.934772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766f408-c905-4047-ae7e-bbda92574219 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:38.935074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766f408-c905-4047-ae7e-bbda92574219 None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/221dab3ebc4f4c68b253729391e9c503/roles/6f21bc5228c14338acc0d1711e7a1742` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:38.955918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766f408-c905-4047-ae7e-bbda92574219 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=221dab3ebc4f4c68b253729391e9c503, role_id=6f21bc5228c14338acc0d1711e7a1742)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:38.957774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766f408-c905-4047-ae7e-bbda92574219 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:38.970332 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 625/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:44:38 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/221dab3ebc4f4c68b253729391e9c503/roles/6f21bc5228c14338acc0d1711e7a1742 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:44:41.503976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e9245-6ad2-4ca8-93ff-d343896524d1 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:41.504533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e9245-6ad2-4ca8-93ff-d343896524d1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:41.504533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e9245-6ad2-4ca8-93ff-d343896524d1 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:41.505922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 608/1233] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:44:41.511602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4fd8-a5be-4e97-8c52-658e29d29b4e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:41.512247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4fd8-a5be-4e97-8c52-658e29d29b4e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:41.512247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4fd8-a5be-4e97-8c52-658e29d29b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:41.529440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-a8dc4fd8-a5be-4e97-8c52-658e29d29b4e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:44:41.530714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a8dc4fd8-a5be-4e97-8c52-658e29d29b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:44:41.602907 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 626/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:44:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:44:41.632961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e9245-6ad2-4ca8-93ff-d343896524d1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:41.768075 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e9245-6ad2-4ca8-93ff-d343896524d1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:41.810405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da3435-a8ef-4a5d-acd7-f2195c694c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:41.811240 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da3435-a8ef-4a5d-acd7-f2195c694c8f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:41.811476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da3435-a8ef-4a5d-acd7-f2195c694c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:41.811745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da3435-a8ef-4a5d-acd7-f2195c694c8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:41.822979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da3435-a8ef-4a5d-acd7-f2195c694c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:44:41.830153 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-27da3435-a8ef-4a5d-acd7-f2195c694c8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 06 12:44:41.832886 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 609/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Wed Apr 6 12:44:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:41.838569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc4fd8-a5be-4e97-8c52-658e29d29b4e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:41.957669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc4fd8-a5be-4e97-8c52-658e29d29b4e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:41.998010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee09cf-e17d-4942-a444-e07b9b210a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:41.998683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee09cf-e17d-4942-a444-e07b9b210a41 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:41.999098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee09cf-e17d-4942-a444-e07b9b210a41 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:41.999412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee09cf-e17d-4942-a444-e07b9b210a41 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:42.000313 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee09cf-e17d-4942-a444-e07b9b210a41 None admin] RBAC: Adding query filter params (name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:42.000642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee09cf-e17d-4942-a444-e07b9b210a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:42.002087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee09cf-e17d-4942-a444-e07b9b210a41 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:42.013773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 627/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Wed Apr 6 12:44:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:42.020902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da3435-a8ef-4a5d-acd7-f2195c694c8f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:42.149997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da3435-a8ef-4a5d-acd7-f2195c694c8f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:42.184300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215ddb7-8019-4755-862f-ca047675134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:42.185086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215ddb7-8019-4755-862f-ca047675134d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:42.185392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215ddb7-8019-4755-862f-ca047675134d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:42.185695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215ddb7-8019-4755-862f-ca047675134d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:42.196529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215ddb7-8019-4755-862f-ca047675134d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:42.198103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215ddb7-8019-4755-862f-ca047675134d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:42.213967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-4215ddb7-8019-4755-862f-ca047675134d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:42.215055 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 610/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:44:42.221175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee09cf-e17d-4942-a444-e07b9b210a41 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:42.331095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee09cf-e17d-4942-a444-e07b9b210a41 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:42.369889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb927fe-36b5-4a3d-8ea6-e67607f1394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:42.370567 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb927fe-36b5-4a3d-8ea6-e67607f1394a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:42.370873 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb927fe-36b5-4a3d-8ea6-e67607f1394a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:42.371210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb927fe-36b5-4a3d-8ea6-e67607f1394a None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:42.371930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb927fe-36b5-4a3d-8ea6-e67607f1394a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:42.372262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb927fe-36b5-4a3d-8ea6-e67607f1394a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:42.373627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb927fe-36b5-4a3d-8ea6-e67607f1394a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:42.392267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 628/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:42.393799 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215ddb7-8019-4755-862f-ca047675134d None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:42.505940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215ddb7-8019-4755-862f-ca047675134d None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:42.544896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9a09e-367a-4964-96bb-1cda61520b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:42.545858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9a09e-367a-4964-96bb-1cda61520b1f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:42.546117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9a09e-367a-4964-96bb-1cda61520b1f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:42.546418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9a09e-367a-4964-96bb-1cda61520b1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:42.555912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9a09e-367a-4964-96bb-1cda61520b1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:42.557515 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9a09e-367a-4964-96bb-1cda61520b1f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:42.572746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-b0b9a09e-367a-4964-96bb-1cda61520b1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 12:44:42.574120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 611/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 06 12:44:42.580214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb927fe-36b5-4a3d-8ea6-e67607f1394a None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:42.699439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb927fe-36b5-4a3d-8ea6-e67607f1394a None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:42.737718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab588f-e2c6-4407-a0b8-313a1413c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:42.739041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab588f-e2c6-4407-a0b8-313a1413c315 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:42.739392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab588f-e2c6-4407-a0b8-313a1413c315 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:42.739744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab588f-e2c6-4407-a0b8-313a1413c315 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:42.740758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab588f-e2c6-4407-a0b8-313a1413c315 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:42.741170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab588f-e2c6-4407-a0b8-313a1413c315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:42.742906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab588f-e2c6-4407-a0b8-313a1413c315 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:42.763111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 629/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Apr 6 12:44:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:44:42.768792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9a09e-367a-4964-96bb-1cda61520b1f None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:42.874173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9a09e-367a-4964-96bb-1cda61520b1f None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:42.907177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6078e-c2ec-450b-bbdf-d76249ff3c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:42.907832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6078e-c2ec-450b-bbdf-d76249ff3c16 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:42.908220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6078e-c2ec-450b-bbdf-d76249ff3c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:42.908359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6078e-c2ec-450b-bbdf-d76249ff3c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:42.983833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6078e-c2ec-450b-bbdf-d76249ff3c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:42.985345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6078e-c2ec-450b-bbdf-d76249ff3c16 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:43.109834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 612/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:44:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:44:43.116070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab588f-e2c6-4407-a0b8-313a1413c315 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:43.226809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab588f-e2c6-4407-a0b8-313a1413c315 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:43.265952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10563bf-48e9-45de-8dd9-2c1a47ed7480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:43.266941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10563bf-48e9-45de-8dd9-2c1a47ed7480 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:43.267255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10563bf-48e9-45de-8dd9-2c1a47ed7480 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:43.267989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10563bf-48e9-45de-8dd9-2c1a47ed7480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:43.280066 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10563bf-48e9-45de-8dd9-2c1a47ed7480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:43.281807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10563bf-48e9-45de-8dd9-2c1a47ed7480 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:43.303395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-e10563bf-48e9-45de-8dd9-2c1a47ed7480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:43.310597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 630/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:43.312046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6078e-c2ec-450b-bbdf-d76249ff3c16 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:43.427831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6078e-c2ec-450b-bbdf-d76249ff3c16 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:43.467701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73f81a-4b9a-4ec7-b8f3-ab89289f253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:43.468507 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73f81a-4b9a-4ec7-b8f3-ab89289f253e None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:43.468848 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73f81a-4b9a-4ec7-b8f3-ab89289f253e None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:43.469150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73f81a-4b9a-4ec7-b8f3-ab89289f253e None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:43.470081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73f81a-4b9a-4ec7-b8f3-ab89289f253e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:43.470451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73f81a-4b9a-4ec7-b8f3-ab89289f253e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:43.472307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73f81a-4b9a-4ec7-b8f3-ab89289f253e None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:43.485938 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 613/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:43.492762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10563bf-48e9-45de-8dd9-2c1a47ed7480 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:43.600143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10563bf-48e9-45de-8dd9-2c1a47ed7480 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:43.637112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33199c-7656-4a26-b1b0-16373dd76e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:43.637994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33199c-7656-4a26-b1b0-16373dd76e06 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:43.638270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33199c-7656-4a26-b1b0-16373dd76e06 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:43.638556 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33199c-7656-4a26-b1b0-16373dd76e06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:43.646007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33199c-7656-4a26-b1b0-16373dd76e06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:43.647496 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33199c-7656-4a26-b1b0-16373dd76e06 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:43.661201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-7d33199c-7656-4a26-b1b0-16373dd76e06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:44:43.662440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 631/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:44:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:43.668707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73f81a-4b9a-4ec7-b8f3-ab89289f253e None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:43.775269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73f81a-4b9a-4ec7-b8f3-ab89289f253e None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:43.810421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a43174-e6fe-4852-b4c3-ba4a9720698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:43.811133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a43174-e6fe-4852-b4c3-ba4a9720698f None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:43.811406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a43174-e6fe-4852-b4c3-ba4a9720698f None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:43.811678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a43174-e6fe-4852-b4c3-ba4a9720698f None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:43.812496 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a43174-e6fe-4852-b4c3-ba4a9720698f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:43.812800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a43174-e6fe-4852-b4c3-ba4a9720698f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:43.814292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a43174-e6fe-4852-b4c3-ba4a9720698f None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:43.835494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 614/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:44:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:44:43.841716 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33199c-7656-4a26-b1b0-16373dd76e06 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:43.952673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33199c-7656-4a26-b1b0-16373dd76e06 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:43.991660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ed51d-e61b-4041-a792-fe6d81470702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:43.992399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed51d-e61b-4041-a792-fe6d81470702 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:43.992783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed51d-e61b-4041-a792-fe6d81470702 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:43.993124 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ed51d-e61b-4041-a792-fe6d81470702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:43.994150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ed51d-e61b-4041-a792-fe6d81470702 None admin] RBAC: Adding query filter params (role.id=6f21bc5228c14338acc0d1711e7a1742, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=221dab3ebc4f4c68b253729391e9c503) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:43.994497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ed51d-e61b-4041-a792-fe6d81470702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:43.996080 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ed51d-e61b-4041-a792-fe6d81470702 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:44.008953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 632/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:44:43 2022] GET /identity/v3/role_assignments?user.id=221dab3ebc4f4c68b253729391e9c503&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=6f21bc5228c14338acc0d1711e7a1742 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:46.669689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9833c-6d0b-4cf1-8a1e-15d5cb5c7535 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:46.670210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9833c-6d0b-4cf1-8a1e-15d5cb5c7535 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:46.670210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9833c-6d0b-4cf1-8a1e-15d5cb5c7535 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:46.672053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 615/1247] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:44:46.677965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6d08a-e77c-48c9-8a17-171d336ca86f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:46.678473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6d08a-e77c-48c9-8a17-171d336ca86f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:46.678780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6d08a-e77c-48c9-8a17-171d336ca86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:46.695708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d5d6d08a-e77c-48c9-8a17-171d336ca86f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:44:46.696898 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d5d6d08a-e77c-48c9-8a17-171d336ca86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:44:46.776744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 633/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:44:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:44:46.805950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9833c-6d0b-4cf1-8a1e-15d5cb5c7535 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:46.920812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9833c-6d0b-4cf1-8a1e-15d5cb5c7535 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:46.959174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157a457-c8b4-4e1d-baf2-6668a91fce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:46.959975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157a457-c8b4-4e1d-baf2-6668a91fce16 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:46.960401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157a457-c8b4-4e1d-baf2-6668a91fce16 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:46.960686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157a457-c8b4-4e1d-baf2-6668a91fce16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:46.972149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157a457-c8b4-4e1d-baf2-6668a91fce16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:44:46.979688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-d157a457-c8b4-4e1d-baf2-6668a91fce16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:44:46.981039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 616/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:44:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:46.987551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6d08a-e77c-48c9-8a17-171d336ca86f None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:47.110666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6d08a-e77c-48c9-8a17-171d336ca86f None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:47.147641 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef566e-ccd5-44cd-af7f-04396b7a3349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:47.148350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef566e-ccd5-44cd-af7f-04396b7a3349 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:47.148633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef566e-ccd5-44cd-af7f-04396b7a3349 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:47.148910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef566e-ccd5-44cd-af7f-04396b7a3349 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:47.149695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef566e-ccd5-44cd-af7f-04396b7a3349 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:47.150012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef566e-ccd5-44cd-af7f-04396b7a3349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:47.151395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef566e-ccd5-44cd-af7f-04396b7a3349 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:47.164526 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 634/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:44:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:47.166086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157a457-c8b4-4e1d-baf2-6668a91fce16 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:47.280338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157a457-c8b4-4e1d-baf2-6668a91fce16 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:47.317228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049e322-3276-4d64-8269-e09c091f1d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:47.318152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049e322-3276-4d64-8269-e09c091f1d15 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:47.318435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049e322-3276-4d64-8269-e09c091f1d15 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:47.318828 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049e322-3276-4d64-8269-e09c091f1d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:47.332554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049e322-3276-4d64-8269-e09c091f1d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:47.334155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049e322-3276-4d64-8269-e09c091f1d15 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:47.352349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-7049e322-3276-4d64-8269-e09c091f1d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:47.353689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 617/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:47.359739 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef566e-ccd5-44cd-af7f-04396b7a3349 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:47.471628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef566e-ccd5-44cd-af7f-04396b7a3349 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:47.507875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597c822-3e44-41c5-8d31-9ed2eec8ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:47.508561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c822-3e44-41c5-8d31-9ed2eec8ae71 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:47.508843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c822-3e44-41c5-8d31-9ed2eec8ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:47.509121 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597c822-3e44-41c5-8d31-9ed2eec8ae71 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:47.509903 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c822-3e44-41c5-8d31-9ed2eec8ae71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:47.510218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c822-3e44-41c5-8d31-9ed2eec8ae71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:47.511659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597c822-3e44-41c5-8d31-9ed2eec8ae71 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:47.530992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 635/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:47.532093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049e322-3276-4d64-8269-e09c091f1d15 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:47.638606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049e322-3276-4d64-8269-e09c091f1d15 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:47.673182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc200a-ac32-4337-890b-2ede438ed52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:47.674020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc200a-ac32-4337-890b-2ede438ed52a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:47.674301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc200a-ac32-4337-890b-2ede438ed52a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:47.674579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc200a-ac32-4337-890b-2ede438ed52a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:47.682860 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc200a-ac32-4337-890b-2ede438ed52a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:47.684330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc200a-ac32-4337-890b-2ede438ed52a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:47.697957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-f6dc200a-ac32-4337-890b-2ede438ed52a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 12:44:47.699169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 618/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:47.705000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597c822-3e44-41c5-8d31-9ed2eec8ae71 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:47.944551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597c822-3e44-41c5-8d31-9ed2eec8ae71 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:47.978557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1e355-626c-4683-8e2c-76c6877986bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:47.979228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1e355-626c-4683-8e2c-76c6877986bf None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:47.979505 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1e355-626c-4683-8e2c-76c6877986bf None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:47.979772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1e355-626c-4683-8e2c-76c6877986bf None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:47.980597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1e355-626c-4683-8e2c-76c6877986bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:47.980899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1e355-626c-4683-8e2c-76c6877986bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:47.982337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1e355-626c-4683-8e2c-76c6877986bf None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:47.999465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 636/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Apr 6 12:44:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:48.005854 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc200a-ac32-4337-890b-2ede438ed52a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:48.111527 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc200a-ac32-4337-890b-2ede438ed52a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:48.144357 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f68a31-9e29-4910-b4fd-1fcc1d7e2728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:48.145016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f68a31-9e29-4910-b4fd-1fcc1d7e2728 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:48.145294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f68a31-9e29-4910-b4fd-1fcc1d7e2728 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:48.145564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f68a31-9e29-4910-b4fd-1fcc1d7e2728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:48.211135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f68a31-9e29-4910-b4fd-1fcc1d7e2728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:48.212525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f68a31-9e29-4910-b4fd-1fcc1d7e2728 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:48.312875 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 619/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:44:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:44:48.319410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1e355-626c-4683-8e2c-76c6877986bf None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:48.423144 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1e355-626c-4683-8e2c-76c6877986bf None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:48.458486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2d76e-d4f2-4649-b9d9-948c0453d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:48.459286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2d76e-d4f2-4649-b9d9-948c0453d969 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:48.459566 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2d76e-d4f2-4649-b9d9-948c0453d969 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:48.459838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2d76e-d4f2-4649-b9d9-948c0453d969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:48.469641 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2d76e-d4f2-4649-b9d9-948c0453d969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:48.471033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef2d76e-d4f2-4649-b9d9-948c0453d969 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:48.489176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-bef2d76e-d4f2-4649-b9d9-948c0453d969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:48.490394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 637/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:48.496148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f68a31-9e29-4910-b4fd-1fcc1d7e2728 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:48.603333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f68a31-9e29-4910-b4fd-1fcc1d7e2728 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:48.635315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ea87a-89f7-478c-9021-e1232870dd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:48.635960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ea87a-89f7-478c-9021-e1232870dd66 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:48.636239 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ea87a-89f7-478c-9021-e1232870dd66 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:48.636512 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ea87a-89f7-478c-9021-e1232870dd66 None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:48.637219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ea87a-89f7-478c-9021-e1232870dd66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:48.637519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ea87a-89f7-478c-9021-e1232870dd66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:48.638917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ea87a-89f7-478c-9021-e1232870dd66 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:48.649874 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 620/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:48.655456 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2d76e-d4f2-4649-b9d9-948c0453d969 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:48.750004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2d76e-d4f2-4649-b9d9-948c0453d969 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:48.782498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7fbdd-378d-4781-b7e0-4f4e1e50ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:48.783278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7fbdd-378d-4781-b7e0-4f4e1e50ed7a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:48.783560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7fbdd-378d-4781-b7e0-4f4e1e50ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:48.783835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7fbdd-378d-4781-b7e0-4f4e1e50ed7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:48.790925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7fbdd-378d-4781-b7e0-4f4e1e50ed7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:48.792360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7fbdd-378d-4781-b7e0-4f4e1e50ed7a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:48.807154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-08a7fbdd-378d-4781-b7e0-4f4e1e50ed7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:44:48.808365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 638/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:44:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:48.814336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ea87a-89f7-478c-9021-e1232870dd66 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:48.914389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ea87a-89f7-478c-9021-e1232870dd66 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:48.946114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fbb3d-b381-4656-986c-6ac85d5bd892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:48.946773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fbb3d-b381-4656-986c-6ac85d5bd892 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:48.947052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fbb3d-b381-4656-986c-6ac85d5bd892 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:48.947322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fbb3d-b381-4656-986c-6ac85d5bd892 None admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:48.948103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fbb3d-b381-4656-986c-6ac85d5bd892 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:48.948402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fbb3d-b381-4656-986c-6ac85d5bd892 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:48.949871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fbb3d-b381-4656-986c-6ac85d5bd892 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:48.962368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 621/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:44:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:48.968534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7fbdd-378d-4781-b7e0-4f4e1e50ed7a None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:49.073286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7fbdd-378d-4781-b7e0-4f4e1e50ed7a None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:49.110924 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8f5a7-d0cc-4756-a70c-d0cdb11438cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:49.111574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f5a7-d0cc-4756-a70c-d0cdb11438cc None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:49.111853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f5a7-d0cc-4756-a70c-d0cdb11438cc None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:49.112126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8f5a7-d0cc-4756-a70c-d0cdb11438cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:49.112973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8f5a7-d0cc-4756-a70c-d0cdb11438cc None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=221dab3ebc4f4c68b253729391e9c503) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:49.113281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8f5a7-d0cc-4756-a70c-d0cdb11438cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:49.114730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8f5a7-d0cc-4756-a70c-d0cdb11438cc None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:49.120063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 639/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:44:48 2022] GET /identity/v3/role_assignments?user.id=221dab3ebc4f4c68b253729391e9c503&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=c158bb1781c44a03890992161076b84b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:51.474919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1150ec-edcc-4104-8e37-f2bec08cd73f None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:51.475468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1150ec-edcc-4104-8e37-f2bec08cd73f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:51.475468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1150ec-edcc-4104-8e37-f2bec08cd73f None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:51.476813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 622/1261] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:44:51.482213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50724438-1e36-48d8-a6c9-7241a87041b9 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:51.482639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50724438-1e36-48d8-a6c9-7241a87041b9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:51.482777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50724438-1e36-48d8-a6c9-7241a87041b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:51.499815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-50724438-1e36-48d8-a6c9-7241a87041b9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:44:51.500991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-50724438-1e36-48d8-a6c9-7241a87041b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:44:51.565802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 640/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:44:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:44:51.587881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1150ec-edcc-4104-8e37-f2bec08cd73f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:51.683654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1150ec-edcc-4104-8e37-f2bec08cd73f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:51.715818 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb016c3-a4dd-4206-b2d8-5eaa8d024976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:51.716598 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb016c3-a4dd-4206-b2d8-5eaa8d024976 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:51.716880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb016c3-a4dd-4206-b2d8-5eaa8d024976 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:51.717154 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb016c3-a4dd-4206-b2d8-5eaa8d024976 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:51.727496 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb016c3-a4dd-4206-b2d8-5eaa8d024976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:44:51.734346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-7cb016c3-a4dd-4206-b2d8-5eaa8d024976 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:44:51.735523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 623/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:51.742909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50724438-1e36-48d8-a6c9-7241a87041b9 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:51.835997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50724438-1e36-48d8-a6c9-7241a87041b9 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:51.867857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73c647-c664-4324-a55a-9d26254c4631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:51.868436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73c647-c664-4324-a55a-9d26254c4631 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:51.868708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73c647-c664-4324-a55a-9d26254c4631 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:51.868977 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73c647-c664-4324-a55a-9d26254c4631 None admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:51.869738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73c647-c664-4324-a55a-9d26254c4631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:51.870042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73c647-c664-4324-a55a-9d26254c4631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:51.871393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73c647-c664-4324-a55a-9d26254c4631 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:51.879002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 641/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:44:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:51.884812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb016c3-a4dd-4206-b2d8-5eaa8d024976 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:51.980325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb016c3-a4dd-4206-b2d8-5eaa8d024976 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:52.012248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34824f-3dd8-46d7-ad9d-84851bc188fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:52.013056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34824f-3dd8-46d7-ad9d-84851bc188fe None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:52.013340 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34824f-3dd8-46d7-ad9d-84851bc188fe None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:52.013643 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34824f-3dd8-46d7-ad9d-84851bc188fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:52.024337 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34824f-3dd8-46d7-ad9d-84851bc188fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:52.025838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34824f-3dd8-46d7-ad9d-84851bc188fe None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:52.041962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-6a34824f-3dd8-46d7-ad9d-84851bc188fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:52.043268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 624/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:52.050142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73c647-c664-4324-a55a-9d26254c4631 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:52.161009 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73c647-c664-4324-a55a-9d26254c4631 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:52.192232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d137d-cd61-4a77-937c-bc718ee69507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:52.192875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d137d-cd61-4a77-937c-bc718ee69507 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:52.193153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d137d-cd61-4a77-937c-bc718ee69507 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:52.193424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d137d-cd61-4a77-937c-bc718ee69507 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:52.194155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d137d-cd61-4a77-937c-bc718ee69507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:52.194456 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d137d-cd61-4a77-937c-bc718ee69507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:52.195804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d137d-cd61-4a77-937c-bc718ee69507 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:52.207402 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 642/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:52.213103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34824f-3dd8-46d7-ad9d-84851bc188fe None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:52.307382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34824f-3dd8-46d7-ad9d-84851bc188fe None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:52.340815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f711a0-1929-429b-94a1-c7860d3d350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:52.341625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f711a0-1929-429b-94a1-c7860d3d350c None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:52.341905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f711a0-1929-429b-94a1-c7860d3d350c None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:52.342171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f711a0-1929-429b-94a1-c7860d3d350c None admin] PATH_INFO: `/v3/users/placement` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:52.349704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f711a0-1929-429b-94a1-c7860d3d350c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:52.351166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f711a0-1929-429b-94a1-c7860d3d350c None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:52.364272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-b6f711a0-1929-429b-94a1-c7860d3d350c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 12:44:52.365431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 625/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:52.371209 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d137d-cd61-4a77-937c-bc718ee69507 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:52.471784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d137d-cd61-4a77-937c-bc718ee69507 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:52.506875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899ab0e-1014-4996-afa7-09cec5acdc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:52.507539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899ab0e-1014-4996-afa7-09cec5acdc82 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:52.507812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899ab0e-1014-4996-afa7-09cec5acdc82 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:52.508081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899ab0e-1014-4996-afa7-09cec5acdc82 None admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:52.508920 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899ab0e-1014-4996-afa7-09cec5acdc82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:52.509229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899ab0e-1014-4996-afa7-09cec5acdc82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:52.510694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899ab0e-1014-4996-afa7-09cec5acdc82 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:52.527305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 643/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Apr 6 12:44:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:52.533495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f711a0-1929-429b-94a1-c7860d3d350c None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:52.632670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f711a0-1929-429b-94a1-c7860d3d350c None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:52.669688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32845f20-efee-4c14-8102-8b54214715b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:52.670475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32845f20-efee-4c14-8102-8b54214715b3 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:52.670754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32845f20-efee-4c14-8102-8b54214715b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:52.671061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32845f20-efee-4c14-8102-8b54214715b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:52.682821 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32845f20-efee-4c14-8102-8b54214715b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:52.684272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32845f20-efee-4c14-8102-8b54214715b3 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:52.700510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-32845f20-efee-4c14-8102-8b54214715b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:52.701694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 626/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:52.707517 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899ab0e-1014-4996-afa7-09cec5acdc82 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:52.805767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899ab0e-1014-4996-afa7-09cec5acdc82 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:52.841439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff023c-eef0-44ef-b9ce-64bc9ca71c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:52.841439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff023c-eef0-44ef-b9ce-64bc9ca71c91 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:52.841439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff023c-eef0-44ef-b9ce-64bc9ca71c91 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:52.841854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff023c-eef0-44ef-b9ce-64bc9ca71c91 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:52.842223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff023c-eef0-44ef-b9ce-64bc9ca71c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:52.842527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff023c-eef0-44ef-b9ce-64bc9ca71c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:52.843892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff023c-eef0-44ef-b9ce-64bc9ca71c91 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:52.855776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 644/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:52.861436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32845f20-efee-4c14-8102-8b54214715b3 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:52.960632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32845f20-efee-4c14-8102-8b54214715b3 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:52.994030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634de00-4c6f-4f71-9aee-1eaaf91d74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:52.994815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634de00-4c6f-4f71-9aee-1eaaf91d74f9 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:52.995091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634de00-4c6f-4f71-9aee-1eaaf91d74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:52.995358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634de00-4c6f-4f71-9aee-1eaaf91d74f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:53.001927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634de00-4c6f-4f71-9aee-1eaaf91d74f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:53.003630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634de00-4c6f-4f71-9aee-1eaaf91d74f9 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:53.016711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-6634de00-4c6f-4f71-9aee-1eaaf91d74f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:44:53.017917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 627/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:53.023998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff023c-eef0-44ef-b9ce-64bc9ca71c91 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:53.135027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff023c-eef0-44ef-b9ce-64bc9ca71c91 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:53.167622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592607a6-a5cc-4f68-b811-8bf6d66b7bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:53.168266 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592607a6-a5cc-4f68-b811-8bf6d66b7bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:53.168544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592607a6-a5cc-4f68-b811-8bf6d66b7bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:53.168811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592607a6-a5cc-4f68-b811-8bf6d66b7bc2 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:53.169602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592607a6-a5cc-4f68-b811-8bf6d66b7bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:53.169911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592607a6-a5cc-4f68-b811-8bf6d66b7bc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:53.171565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592607a6-a5cc-4f68-b811-8bf6d66b7bc2 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:53.184029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 645/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:44:53.190586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634de00-4c6f-4f71-9aee-1eaaf91d74f9 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:53.299071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634de00-4c6f-4f71-9aee-1eaaf91d74f9 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:53.332266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd54bb-1052-4564-8c03-f8cd36c29ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:53.333138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd54bb-1052-4564-8c03-f8cd36c29ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:53.333411 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd54bb-1052-4564-8c03-f8cd36c29ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:53.333712 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd54bb-1052-4564-8c03-f8cd36c29ef6 None admin] PATH_INFO: `/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/221dab3ebc4f4c68b253729391e9c503/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:53.335635 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd54bb-1052-4564-8c03-f8cd36c29ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bfa416e3db24ec3bd6b930f3e35f207, user_id=221dab3ebc4f4c68b253729391e9c503, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:53.337090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd54bb-1052-4564-8c03-f8cd36c29ef6 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:53.350230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 628/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Wed Apr 6 12:44:53 2022] PUT /identity/v3/projects/2bfa416e3db24ec3bd6b930f3e35f207/users/221dab3ebc4f4c68b253729391e9c503/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:44:55.761804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e66525-989e-4948-b5d7-84ccd54df7f8 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:55.762305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e66525-989e-4948-b5d7-84ccd54df7f8 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:55.762305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e66525-989e-4948-b5d7-84ccd54df7f8 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:55.763621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 646/1274] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:44:55.768952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed8c3d-5fd5-48cf-84ec-12eb7757431e None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:55.769343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed8c3d-5fd5-48cf-84ec-12eb7757431e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:55.769498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed8c3d-5fd5-48cf-84ec-12eb7757431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:55.785771 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-82ed8c3d-5fd5-48cf-84ec-12eb7757431e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:44:55.786933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-82ed8c3d-5fd5-48cf-84ec-12eb7757431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:44:55.853393 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 629/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:44:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:44:55.878661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e66525-989e-4948-b5d7-84ccd54df7f8 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:55.976352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e66525-989e-4948-b5d7-84ccd54df7f8 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:56.012429 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8844d-722d-4479-b529-7369b11b8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:56.013220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8844d-722d-4479-b529-7369b11b8531 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:56.013503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8844d-722d-4479-b529-7369b11b8531 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:56.013805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8844d-722d-4479-b529-7369b11b8531 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:56.026646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8844d-722d-4479-b529-7369b11b8531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 06 12:44:56.035538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-29f8844d-722d-4479-b529-7369b11b8531 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 06 12:44:56.036945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 647/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Wed Apr 6 12:44:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:56.043255 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed8c3d-5fd5-48cf-84ec-12eb7757431e None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:56.158201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed8c3d-5fd5-48cf-84ec-12eb7757431e None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:56.196599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdf85c-ed52-4f78-9863-56e4788bd4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:56.197263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf85c-ed52-4f78-9863-56e4788bd4f4 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:56.197635 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf85c-ed52-4f78-9863-56e4788bd4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:56.197889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf85c-ed52-4f78-9863-56e4788bd4f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:56.198639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdf85c-ed52-4f78-9863-56e4788bd4f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:56.198949 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdf85c-ed52-4f78-9863-56e4788bd4f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:56.200356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdf85c-ed52-4f78-9863-56e4788bd4f4 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:56.209348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 630/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Wed Apr 6 12:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:56.215142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8844d-722d-4479-b529-7369b11b8531 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:56.317493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8844d-722d-4479-b529-7369b11b8531 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:56.353538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea1a43-855f-4ae3-b804-d63709ff1fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:56.354426 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1a43-855f-4ae3-b804-d63709ff1fcb None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:56.354708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1a43-855f-4ae3-b804-d63709ff1fcb None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:56.354981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1a43-855f-4ae3-b804-d63709ff1fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:56.365839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea1a43-855f-4ae3-b804-d63709ff1fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:56.367380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea1a43-855f-4ae3-b804-d63709ff1fcb None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:56.384057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-9fea1a43-855f-4ae3-b804-d63709ff1fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:56.385289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 648/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:56.391241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdf85c-ed52-4f78-9863-56e4788bd4f4 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:56.497755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdf85c-ed52-4f78-9863-56e4788bd4f4 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:56.532523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc401b4-6fd3-4cdc-a661-1828e7e8d6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:56.533190 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc401b4-6fd3-4cdc-a661-1828e7e8d6da None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:56.533476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc401b4-6fd3-4cdc-a661-1828e7e8d6da None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:56.534522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc401b4-6fd3-4cdc-a661-1828e7e8d6da None admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:56.535850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc401b4-6fd3-4cdc-a661-1828e7e8d6da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:56.536184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc401b4-6fd3-4cdc-a661-1828e7e8d6da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:56.537769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc401b4-6fd3-4cdc-a661-1828e7e8d6da None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:56.552158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 631/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:56.557961 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea1a43-855f-4ae3-b804-d63709ff1fcb None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:56.661316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea1a43-855f-4ae3-b804-d63709ff1fcb None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:56.693287 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3c304-bf1f-484d-a2b9-048743853f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:56.694096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3c304-bf1f-484d-a2b9-048743853f35 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:56.694377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3c304-bf1f-484d-a2b9-048743853f35 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:56.694644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3c304-bf1f-484d-a2b9-048743853f35 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:56.701746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3c304-bf1f-484d-a2b9-048743853f35 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:56.703163 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3c304-bf1f-484d-a2b9-048743853f35 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:56.716654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-82d3c304-bf1f-484d-a2b9-048743853f35 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 06 12:44:56.717844 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 649/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:56.723856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc401b4-6fd3-4cdc-a661-1828e7e8d6da None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:56.819395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc401b4-6fd3-4cdc-a661-1828e7e8d6da None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:56.851131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce87ae8-2c55-4b4d-b4ae-d8e1a245f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:56.851787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce87ae8-2c55-4b4d-b4ae-d8e1a245f5af None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:56.852069 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce87ae8-2c55-4b4d-b4ae-d8e1a245f5af None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:56.852344 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce87ae8-2c55-4b4d-b4ae-d8e1a245f5af None admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:56.853174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce87ae8-2c55-4b4d-b4ae-d8e1a245f5af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:56.853479 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce87ae8-2c55-4b4d-b4ae-d8e1a245f5af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:56.854961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce87ae8-2c55-4b4d-b4ae-d8e1a245f5af None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:56.871670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 632/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Wed Apr 6 12:44:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:56.877377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3c304-bf1f-484d-a2b9-048743853f35 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:56.971024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3c304-bf1f-484d-a2b9-048743853f35 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:57.001949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f2a1-fc48-4157-a074-1a08b9e03cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:57.002772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f2a1-fc48-4157-a074-1a08b9e03cb0 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:57.003242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f2a1-fc48-4157-a074-1a08b9e03cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:57.003369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f2a1-fc48-4157-a074-1a08b9e03cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:57.071198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21f2a1-fc48-4157-a074-1a08b9e03cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:57.072648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21f2a1-fc48-4157-a074-1a08b9e03cb0 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:57.166414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 650/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Wed Apr 6 12:44:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 06 12:44:57.172877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce87ae8-2c55-4b4d-b4ae-d8e1a245f5af None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:57.276199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce87ae8-2c55-4b4d-b4ae-d8e1a245f5af None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:57.307922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeff02-fc71-4867-879a-1778034fa7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:57.308698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeff02-fc71-4867-879a-1778034fa7b7 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:57.308976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeff02-fc71-4867-879a-1778034fa7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:57.309247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfeff02-fc71-4867-879a-1778034fa7b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:57.319244 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfeff02-fc71-4867-879a-1778034fa7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:57.320695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfeff02-fc71-4867-879a-1778034fa7b7 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:57.337594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-1bfeff02-fc71-4867-879a-1778034fa7b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 06 12:44:57.338801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 633/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:57.344470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f2a1-fc48-4157-a074-1a08b9e03cb0 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:57.436907 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f2a1-fc48-4157-a074-1a08b9e03cb0 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:57.470147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fa9a8-b386-41db-852f-1e7b3da1b527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:57.470790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fa9a8-b386-41db-852f-1e7b3da1b527 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:57.471101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fa9a8-b386-41db-852f-1e7b3da1b527 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:57.471381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fa9a8-b386-41db-852f-1e7b3da1b527 None admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:57.472094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fa9a8-b386-41db-852f-1e7b3da1b527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:57.472393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fa9a8-b386-41db-852f-1e7b3da1b527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:57.473806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fa9a8-b386-41db-852f-1e7b3da1b527 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:57.484343 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 651/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Wed Apr 6 12:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:57.490176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeff02-fc71-4867-879a-1778034fa7b7 None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:57.598277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfeff02-fc71-4867-879a-1778034fa7b7 None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:57.630074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523cac0-695e-4d0c-bdff-dacbd3c2510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:57.630856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523cac0-695e-4d0c-bdff-dacbd3c2510a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:57.631137 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523cac0-695e-4d0c-bdff-dacbd3c2510a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:57.631410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523cac0-695e-4d0c-bdff-dacbd3c2510a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:57.637773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523cac0-695e-4d0c-bdff-dacbd3c2510a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:57.639227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523cac0-695e-4d0c-bdff-dacbd3c2510a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:57.652401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING keystone.server.flask.application [None req-2523cac0-695e-4d0c-bdff-dacbd3c2510a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 06 12:44:57.653562 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 634/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Wed Apr 6 12:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:44:57.659807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fa9a8-b386-41db-852f-1e7b3da1b527 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:57.753910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fa9a8-b386-41db-852f-1e7b3da1b527 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:57.784808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b1bbe-1332-437c-804f-d71c01f20f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:57.785446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b1bbe-1332-437c-804f-d71c01f20f89 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:57.785754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b1bbe-1332-437c-804f-d71c01f20f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:57.786024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b1bbe-1332-437c-804f-d71c01f20f89 None admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:57.786792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b1bbe-1332-437c-804f-d71c01f20f89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:57.787092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b1bbe-1332-437c-804f-d71c01f20f89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:57.788511 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b1bbe-1332-437c-804f-d71c01f20f89 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:57.800559 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 652/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Wed Apr 6 12:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:44:57.807323 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523cac0-695e-4d0c-bdff-dacbd3c2510a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:44:57.901089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523cac0-695e-4d0c-bdff-dacbd3c2510a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:44:57.932724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d19ef8-a1ea-492c-a916-159dc7900a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:44:57.933404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d19ef8-a1ea-492c-a916-159dc7900a05 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:44:57.933748 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d19ef8-a1ea-492c-a916-159dc7900a05 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:44:57.934025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d19ef8-a1ea-492c-a916-159dc7900a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:44:57.934970 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d19ef8-a1ea-492c-a916-159dc7900a05 None admin] RBAC: Adding query filter params (role.id=c158bb1781c44a03890992161076b84b, scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207, user.id=221dab3ebc4f4c68b253729391e9c503) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:44:57.935315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d19ef8-a1ea-492c-a916-159dc7900a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:44:57.936872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d19ef8-a1ea-492c-a916-159dc7900a05 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:44:57.943523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 635/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Wed Apr 6 12:44:57 2022] GET /identity/v3/role_assignments?user.id=221dab3ebc4f4c68b253729391e9c503&scope.project.id=2bfa416e3db24ec3bd6b930f3e35f207&role.id=c158bb1781c44a03890992161076b84b => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:45:00.311764 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33432da2-fbd2-489b-8ec1-f0c5bf1df8b6 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:00.312302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33432da2-fbd2-489b-8ec1-f0c5bf1df8b6 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:00.312302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33432da2-fbd2-489b-8ec1-f0c5bf1df8b6 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:00.313682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 653/1288] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:45:00.320038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ce47-c6fa-4c63-9f10-04af9176b3fc None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:00.320551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ce47-c6fa-4c63-9f10-04af9176b3fc None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:00.320641 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52ce47-c6fa-4c63-9f10-04af9176b3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:00.341043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-ff52ce47-c6fa-4c63-9f10-04af9176b3fc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:45:00.342301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ff52ce47-c6fa-4c63-9f10-04af9176b3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:45:00.413405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 636/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:45:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:45:00.435939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33432da2-fbd2-489b-8ec1-f0c5bf1df8b6 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:00.539739 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33432da2-fbd2-489b-8ec1-f0c5bf1df8b6 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:00.572334 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4c5d1-a3b7-4cea-b291-5dfdb676f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:00.573045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4c5d1-a3b7-4cea-b291-5dfdb676f6fc None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:00.573325 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4c5d1-a3b7-4cea-b291-5dfdb676f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:00.573618 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4c5d1-a3b7-4cea-b291-5dfdb676f6fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:00.574270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4c5d1-a3b7-4cea-b291-5dfdb676f6fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:00.575635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4c5d1-a3b7-4cea-b291-5dfdb676f6fc None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:00.586218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-e7f4c5d1-a3b7-4cea-b291-5dfdb676f6fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 06 12:45:00.587386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 654/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Apr 6 12:45:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:45:00.594952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52ce47-c6fa-4c63-9f10-04af9176b3fc None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:00.693140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52ce47-c6fa-4c63-9f10-04af9176b3fc None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:00.739593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d17e76c-f55b-4b77-a62b-5a243f4ab86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:00.740685 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17e76c-f55b-4b77-a62b-5a243f4ab86d None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:00.741141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17e76c-f55b-4b77-a62b-5a243f4ab86d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:00.741597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d17e76c-f55b-4b77-a62b-5a243f4ab86d None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:00.742739 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17e76c-f55b-4b77-a62b-5a243f4ab86d None admin] RBAC: Adding query filter params (name=placement) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:45:00.743237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17e76c-f55b-4b77-a62b-5a243f4ab86d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:00.745669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d17e76c-f55b-4b77-a62b-5a243f4ab86d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:00.753284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 637/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Apr 6 12:45:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:45:00.758820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4c5d1-a3b7-4cea-b291-5dfdb676f6fc None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:00.859558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4c5d1-a3b7-4cea-b291-5dfdb676f6fc None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:00.892410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c25917-e588-43b2-bb61-5c7a511dd85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:00.893652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c25917-e588-43b2-bb61-5c7a511dd85a None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:00.894218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c25917-e588-43b2-bb61-5c7a511dd85a None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:00.894218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c25917-e588-43b2-bb61-5c7a511dd85a None admin] PATH_INFO: `/v3/services` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:00.895038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c25917-e588-43b2-bb61-5c7a511dd85a None admin] RBAC: Adding query filter params (type=placement) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:45:00.895338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c25917-e588-43b2-bb61-5c7a511dd85a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:00.896922 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c25917-e588-43b2-bb61-5c7a511dd85a None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:00.901939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 655/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Apr 6 12:45:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:45:03.250611 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92017-f71b-4aa3-b6e3-a8511644c53f None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:03.251505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92017-f71b-4aa3-b6e3-a8511644c53f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:03.251505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92017-f71b-4aa3-b6e3-a8511644c53f None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:03.253248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 638/1293] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:45:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:45:03.258792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4461b-4a48-4d9f-a244-be8dbedbe9cd None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:03.259243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4461b-4a48-4d9f-a244-be8dbedbe9cd None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:03.259341 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4461b-4a48-4d9f-a244-be8dbedbe9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:03.276387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-14c4461b-4a48-4d9f-a244-be8dbedbe9cd None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:45:03.277556 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-14c4461b-4a48-4d9f-a244-be8dbedbe9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:45:03.341868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 656/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:45:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:45:03.366515 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92017-f71b-4aa3-b6e3-a8511644c53f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:03.461207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92017-f71b-4aa3-b6e3-a8511644c53f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:03.495601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86754ae9-43ae-4a22-bab0-0b6844bae16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:03.496269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86754ae9-43ae-4a22-bab0-0b6844bae16d None admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:03.496572 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86754ae9-43ae-4a22-bab0-0b6844bae16d None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:03.497037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86754ae9-43ae-4a22-bab0-0b6844bae16d None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:03.498092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86754ae9-43ae-4a22-bab0-0b6844bae16d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:03.499495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86754ae9-43ae-4a22-bab0-0b6844bae16d None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:03.512605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 639/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Wed Apr 6 12:45:03 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:45:06.104319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793acee-6cb0-4206-b092-e6b900038bd0 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:06.104888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793acee-6cb0-4206-b092-e6b900038bd0 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:06.104888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793acee-6cb0-4206-b092-e6b900038bd0 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:06.106248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 657/1296] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:45:06.112020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54f785-a9b8-44e8-aa17-adc089a235f4 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:06.113095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54f785-a9b8-44e8-aa17-adc089a235f4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:06.113095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54f785-a9b8-44e8-aa17-adc089a235f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:06.130845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-ab54f785-a9b8-44e8-aa17-adc089a235f4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:45:06.132021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ab54f785-a9b8-44e8-aa17-adc089a235f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:45:06.219548 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 640/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:45:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 06 12:45:06.245042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793acee-6cb0-4206-b092-e6b900038bd0 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:06.384597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793acee-6cb0-4206-b092-e6b900038bd0 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:06.433232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a988027-ba1f-4e6e-89e7-b3b50c2d8051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:06.434443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988027-ba1f-4e6e-89e7-b3b50c2d8051 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:06.434880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988027-ba1f-4e6e-89e7-b3b50c2d8051 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:06.435302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a988027-ba1f-4e6e-89e7-b3b50c2d8051 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:06.436331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a988027-ba1f-4e6e-89e7-b3b50c2d8051 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:06.438574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a988027-ba1f-4e6e-89e7-b3b50c2d8051 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:06.456424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-3a988027-ba1f-4e6e-89e7-b3b50c2d8051 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 06 12:45:06.458264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 658/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Apr 6 12:45:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:45:06.464391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54f785-a9b8-44e8-aa17-adc089a235f4 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:06.566803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54f785-a9b8-44e8-aa17-adc089a235f4 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:06.598369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76679c-4aa2-4b3f-af49-74a997f5dd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:06.599046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76679c-4aa2-4b3f-af49-74a997f5dd6a None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:06.599304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76679c-4aa2-4b3f-af49-74a997f5dd6a None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:06.599578 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f76679c-4aa2-4b3f-af49-74a997f5dd6a None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:06.600277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76679c-4aa2-4b3f-af49-74a997f5dd6a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:45:06.600579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76679c-4aa2-4b3f-af49-74a997f5dd6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:06.602023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f76679c-4aa2-4b3f-af49-74a997f5dd6a None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:06.606937 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 641/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Apr 6 12:45:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:45:06.613675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a988027-ba1f-4e6e-89e7-b3b50c2d8051 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:06.721928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a988027-ba1f-4e6e-89e7-b3b50c2d8051 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:06.753954 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1995019-d462-473d-8839-b2684138ef07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:06.754605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1995019-d462-473d-8839-b2684138ef07 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:06.754888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1995019-d462-473d-8839-b2684138ef07 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:06.755164 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1995019-d462-473d-8839-b2684138ef07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:06.755983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1995019-d462-473d-8839-b2684138ef07 None admin] RBAC: Adding query filter params (interface=public, service_id=52a889de757c49bf930c2d81c0d36ccd, region_id=RegionOne) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:45:06.756299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1995019-d462-473d-8839-b2684138ef07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:06.757687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1995019-d462-473d-8839-b2684138ef07 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:06.762523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 659/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Wed Apr 6 12:45:06 2022] GET /identity/v3/endpoints?service_id=52a889de757c49bf930c2d81c0d36ccd&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:45:06.768916 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76679c-4aa2-4b3f-af49-74a997f5dd6a None admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:06.863934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f76679c-4aa2-4b3f-af49-74a997f5dd6a None admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:06.897003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fe3da-dcf8-4bc8-8c3e-3f7776e91555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:06.897684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fe3da-dcf8-4bc8-8c3e-3f7776e91555 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:06.897969 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fe3da-dcf8-4bc8-8c3e-3f7776e91555 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:06.898247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fe3da-dcf8-4bc8-8c3e-3f7776e91555 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:06.898927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fe3da-dcf8-4bc8-8c3e-3f7776e91555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:06.900328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fe3da-dcf8-4bc8-8c3e-3f7776e91555 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:06.906957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 642/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Wed Apr 6 12:45:06 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:45:09.318474 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244049-1d21-4350-8ab7-b666970d5ccc None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:09.319202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244049-1d21-4350-8ab7-b666970d5ccc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:09.319202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244049-1d21-4350-8ab7-b666970d5ccc None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:09.320338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 660/1302] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:45:09.326121 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714674a-7708-4e07-a361-be87ff37c698 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:09.326595 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714674a-7708-4e07-a361-be87ff37c698 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:09.326763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714674a-7708-4e07-a361-be87ff37c698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:09.344842 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-2714674a-7708-4e07-a361-be87ff37c698 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:45:09.346219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2714674a-7708-4e07-a361-be87ff37c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:45:09.432038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 643/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:45:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 06 12:45:09.466619 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244049-1d21-4350-8ab7-b666970d5ccc None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:09.573000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244049-1d21-4350-8ab7-b666970d5ccc None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:09.618584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d841-0d3b-4cca-a236-80d96246e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:09.619387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d841-0d3b-4cca-a236-80d96246e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:09.619674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d841-0d3b-4cca-a236-80d96246e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:09.619951 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d841-0d3b-4cca-a236-80d96246e6b2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:09.620607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24d841-0d3b-4cca-a236-80d96246e6b2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:09.622031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24d841-0d3b-4cca-a236-80d96246e6b2 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:09.633872 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING keystone.server.flask.application [None req-ed24d841-0d3b-4cca-a236-80d96246e6b2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 06 12:45:09.635130 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 661/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Wed Apr 6 12:45:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 06 12:45:09.641720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714674a-7708-4e07-a361-be87ff37c698 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:09.745010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714674a-7708-4e07-a361-be87ff37c698 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:09.778423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c5e758-87a5-4d25-8191-fb79392df736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:09.779140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e758-87a5-4d25-8191-fb79392df736 None admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:09.779421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e758-87a5-4d25-8191-fb79392df736 None admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:09.779689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c5e758-87a5-4d25-8191-fb79392df736 None admin] PATH_INFO: `/v3/services` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:09.780385 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5e758-87a5-4d25-8191-fb79392df736 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:45:09.780685 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5e758-87a5-4d25-8191-fb79392df736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:09.782295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c5e758-87a5-4d25-8191-fb79392df736 None admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:09.788126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 644/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Wed Apr 6 12:45:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:45:09.795805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d841-0d3b-4cca-a236-80d96246e6b2 None admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:45:09.901943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d841-0d3b-4cca-a236-80d96246e6b2 None admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:45:09.937971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cb573-fc89-42db-a384-c9866cd45015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:45:09.938682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cb573-fc89-42db-a384-c9866cd45015 None admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:45:09.938979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cb573-fc89-42db-a384-c9866cd45015 None admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:45:09.939294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cb573-fc89-42db-a384-c9866cd45015 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:45:09.940524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cb573-fc89-42db-a384-c9866cd45015 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:45:09.941921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cb573-fc89-42db-a384-c9866cd45015 None admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:45:09.960764 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 662/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Wed Apr 6 12:45:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:46:16.701620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148ee0-d469-4024-a3ad-31c13bfa0791 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:16.701620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148ee0-d469-4024-a3ad-31c13bfa0791 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:16.701620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148ee0-d469-4024-a3ad-31c13bfa0791 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:16.709247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870b234-93b2-4bf2-a4af-0698ac64f606 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:16.710137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870b234-93b2-4bf2-a4af-0698ac64f606 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:16.710568 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870b234-93b2-4bf2-a4af-0698ac64f606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:16.714111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 645/1307] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:16.790098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3870b234-93b2-4bf2-a4af-0698ac64f606 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:16.791586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3870b234-93b2-4bf2-a4af-0698ac64f606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:16.905604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 663/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:16.946358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3b16-5d60-416a-a6aa-019a356b7a00 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:16.946884 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3b16-5d60-416a-a6aa-019a356b7a00 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:16.947307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f3b16-5d60-416a-a6aa-019a356b7a00 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:16.949485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 646/1309] 10.222.0.23 () {54 vars in 963 bytes} [Wed Apr 6 12:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:16.959029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fca4e3-83dc-4c9d-8b54-716dee1271a9 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:16.959426 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fca4e3-83dc-4c9d-8b54-716dee1271a9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:16.959810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fca4e3-83dc-4c9d-8b54-716dee1271a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:17.119051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-a6fca4e3-83dc-4c9d-8b54-716dee1271a9 None None] MFA Rules not processed for user `7bd327cdfe2c4f729252d86838aae638`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:17.120427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a6fca4e3-83dc-4c9d-8b54-716dee1271a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:17.243188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 664/1310] 10.222.0.23 () {58 vars in 1060 bytes} [Wed Apr 6 12:46:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:46:17.253716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f3b16-5d60-416a-a6aa-019a356b7a00 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:17.256227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-147f3b16-5d60-416a-a6aa-019a356b7a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:17.512039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f3b16-5d60-416a-a6aa-019a356b7a00 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:17.610003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce6df1-6350-4e1c-9fa1-d8e818019aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:17.611302 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce6df1-6350-4e1c-9fa1-d8e818019aaa service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:17.611586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce6df1-6350-4e1c-9fa1-d8e818019aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:17.611860 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce6df1-6350-4e1c-9fa1-d8e818019aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:17.613634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f3ce6df1-6350-4e1c-9fa1-d8e818019aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:17.739106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce6df1-6350-4e1c-9fa1-d8e818019aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:17.740581 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce6df1-6350-4e1c-9fa1-d8e818019aaa service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:17.762660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 647/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:20.494043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ab90b-b30e-4154-8c0f-1fad10aa481c None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:20.494596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ab90b-b30e-4154-8c0f-1fad10aa481c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:20.494596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ab90b-b30e-4154-8c0f-1fad10aa481c None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:20.496000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 665/1312] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:20.502305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d04f5-6ded-4ac7-a018-5ff1568d8b10 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:20.502855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d04f5-6ded-4ac7-a018-5ff1568d8b10 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:20.502855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d04f5-6ded-4ac7-a018-5ff1568d8b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:20.600997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-511d04f5-6ded-4ac7-a018-5ff1568d8b10 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:20.602142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-511d04f5-6ded-4ac7-a018-5ff1568d8b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:20.711127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 648/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:20.752655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ab90b-b30e-4154-8c0f-1fad10aa481c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:20.755403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bd8ab90b-b30e-4154-8c0f-1fad10aa481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:20.896159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ab90b-b30e-4154-8c0f-1fad10aa481c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:20.970220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e96ac-ef2f-47db-ae32-60dcb25b8f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:20.970892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e96ac-ef2f-47db-ae32-60dcb25b8f23 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:20.971167 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e96ac-ef2f-47db-ae32-60dcb25b8f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:20.971438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e96ac-ef2f-47db-ae32-60dcb25b8f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:20.973063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-145e96ac-ef2f-47db-ae32-60dcb25b8f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:21.080766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e96ac-ef2f-47db-ae32-60dcb25b8f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:21.082229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e96ac-ef2f-47db-ae32-60dcb25b8f23 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:21.100324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 666/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:23.755248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec080796-43ba-468b-87d4-12f6226f5fb3 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:23.755762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec080796-43ba-468b-87d4-12f6226f5fb3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:23.755762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec080796-43ba-468b-87d4-12f6226f5fb3 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:23.757067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 649/1315] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:23.762247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc779ad-6f0d-46b0-8f42-482895605466 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:23.762705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc779ad-6f0d-46b0-8f42-482895605466 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:23.762805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc779ad-6f0d-46b0-8f42-482895605466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:23.830394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-fbc779ad-6f0d-46b0-8f42-482895605466 None None] MFA Rules not processed for user `12463e0931d04a7d9563aa3ed23c06af`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:23.831625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-fbc779ad-6f0d-46b0-8f42-482895605466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:23.929729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 667/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:23.971363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec080796-43ba-468b-87d4-12f6226f5fb3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:23.972919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ec080796-43ba-468b-87d4-12f6226f5fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:24.074850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec080796-43ba-468b-87d4-12f6226f5fb3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:24.150384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617d224-224c-440d-ab02-7d3b5e882cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:24.152019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617d224-224c-440d-ab02-7d3b5e882cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:24.152303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617d224-224c-440d-ab02-7d3b5e882cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:24.152579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617d224-224c-440d-ab02-7d3b5e882cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:24.154260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d617d224-224c-440d-ab02-7d3b5e882cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:24.261184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617d224-224c-440d-ab02-7d3b5e882cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:24.262686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617d224-224c-440d-ab02-7d3b5e882cf2 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:24.280642 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 650/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:27.194261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea8cc-c72f-4bba-86d8-a84265fbe9d4 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:27.194811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea8cc-c72f-4bba-86d8-a84265fbe9d4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:27.194811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ea8cc-c72f-4bba-86d8-a84265fbe9d4 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:27.196141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 668/1318] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:27.201716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb66959-d455-4fee-b982-0e3fdb965af9 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:27.202170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb66959-d455-4fee-b982-0e3fdb965af9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:27.202263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb66959-d455-4fee-b982-0e3fdb965af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:27.266570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-edb66959-d455-4fee-b982-0e3fdb965af9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:27.267934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-edb66959-d455-4fee-b982-0e3fdb965af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:27.362946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 651/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:27.403194 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ea8cc-c72f-4bba-86d8-a84265fbe9d4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:27.404735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-699ea8cc-c72f-4bba-86d8-a84265fbe9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:27.519956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ea8cc-c72f-4bba-86d8-a84265fbe9d4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:27.590418 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05400a72-57fd-45bc-a12d-41720a6124c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:27.590968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05400a72-57fd-45bc-a12d-41720a6124c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:27.591247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05400a72-57fd-45bc-a12d-41720a6124c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:27.591520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05400a72-57fd-45bc-a12d-41720a6124c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:27.593134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-05400a72-57fd-45bc-a12d-41720a6124c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:27.698840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05400a72-57fd-45bc-a12d-41720a6124c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:27.700257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05400a72-57fd-45bc-a12d-41720a6124c0 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:27.719190 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 669/1320] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:30.748324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796488e7-458e-48cd-bb99-c72860735938 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:30.748832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796488e7-458e-48cd-bb99-c72860735938 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:30.748832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796488e7-458e-48cd-bb99-c72860735938 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:30.750814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 652/1321] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:30.756101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8282cf-0bfb-4e47-9e9b-f82412bbf50e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:30.756536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8282cf-0bfb-4e47-9e9b-f82412bbf50e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:30.756656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8282cf-0bfb-4e47-9e9b-f82412bbf50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:30.820659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5d8282cf-0bfb-4e47-9e9b-f82412bbf50e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:30.821877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5d8282cf-0bfb-4e47-9e9b-f82412bbf50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:30.925659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 670/1322] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:30.962443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796488e7-458e-48cd-bb99-c72860735938 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:30.964057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-796488e7-458e-48cd-bb99-c72860735938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:31.066043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796488e7-458e-48cd-bb99-c72860735938 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:31.137643 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccea7db-b890-4ba5-af70-42314c1e91a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:31.138291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccea7db-b890-4ba5-af70-42314c1e91a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:31.138570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccea7db-b890-4ba5-af70-42314c1e91a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:31.138843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccea7db-b890-4ba5-af70-42314c1e91a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:31.141077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2ccea7db-b890-4ba5-af70-42314c1e91a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:31.247361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccea7db-b890-4ba5-af70-42314c1e91a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:31.248835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccea7db-b890-4ba5-af70-42314c1e91a9 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:31.267357 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 653/1323] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:33.631637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfa97-aff8-4d24-91cd-01abae778ff7 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:33.632210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfa97-aff8-4d24-91cd-01abae778ff7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:33.632210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bfa97-aff8-4d24-91cd-01abae778ff7 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:33.633511 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 671/1324] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:33.639446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c56aa-8c0e-4d6f-8246-cd919a3228a9 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:33.640019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c56aa-8c0e-4d6f-8246-cd919a3228a9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:33.640019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c56aa-8c0e-4d6f-8246-cd919a3228a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:33.702631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-bb5c56aa-8c0e-4d6f-8246-cd919a3228a9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:33.704419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bb5c56aa-8c0e-4d6f-8246-cd919a3228a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:33.796057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 654/1325] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:33.833189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bfa97-aff8-4d24-91cd-01abae778ff7 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:33.834733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bc3bfa97-aff8-4d24-91cd-01abae778ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:33.933615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bfa97-aff8-4d24-91cd-01abae778ff7 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:34.002658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7eaa5-bfaa-4988-85c0-aa7179500a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:34.003303 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7eaa5-bfaa-4988-85c0-aa7179500a87 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:34.003584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7eaa5-bfaa-4988-85c0-aa7179500a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:34.003855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7eaa5-bfaa-4988-85c0-aa7179500a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:34.005477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-83b7eaa5-bfaa-4988-85c0-aa7179500a87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:34.111908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7eaa5-bfaa-4988-85c0-aa7179500a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:34.113344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7eaa5-bfaa-4988-85c0-aa7179500a87 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:34.131302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 672/1326] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:36.514070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f381-6dba-4f5d-af2f-e512e53b471a None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:36.514620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f381-6dba-4f5d-af2f-e512e53b471a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:36.514620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f381-6dba-4f5d-af2f-e512e53b471a None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:36.516277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 655/1327] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:46:36.522016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d061f-22ac-42e1-adcc-416b08d269f2 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:36.522537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d061f-22ac-42e1-adcc-416b08d269f2 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:36.522695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d061f-22ac-42e1-adcc-416b08d269f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:36.593002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-f17d061f-22ac-42e1-adcc-416b08d269f2 None None] MFA Rules not processed for user `12463e0931d04a7d9563aa3ed23c06af`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:36.594687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f17d061f-22ac-42e1-adcc-416b08d269f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:36.705463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 673/1328] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:36.745150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74f381-6dba-4f5d-af2f-e512e53b471a None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:36.746739 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ef74f381-6dba-4f5d-af2f-e512e53b471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:36.864483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74f381-6dba-4f5d-af2f-e512e53b471a None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:36.949287 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475eb2b-2dcc-4787-8940-61e2f66b9c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:36.950018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475eb2b-2dcc-4787-8940-61e2f66b9c44 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:36.950308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475eb2b-2dcc-4787-8940-61e2f66b9c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:36.950607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475eb2b-2dcc-4787-8940-61e2f66b9c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:36.952287 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6475eb2b-2dcc-4787-8940-61e2f66b9c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:37.068054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475eb2b-2dcc-4787-8940-61e2f66b9c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:37.069539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475eb2b-2dcc-4787-8940-61e2f66b9c44 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:37.089420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 656/1329] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:39.745111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7adbd-b708-45b0-939e-cdf667c6ce1e None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:39.745642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7adbd-b708-45b0-939e-cdf667c6ce1e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:39.745642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7adbd-b708-45b0-939e-cdf667c6ce1e None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:39.746956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 674/1330] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:39.753075 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0aa2-31bb-4b5f-aa7b-47691dd748d7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:39.753589 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0aa2-31bb-4b5f-aa7b-47691dd748d7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:39.753688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e0aa2-31bb-4b5f-aa7b-47691dd748d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:39.820371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-055e0aa2-31bb-4b5f-aa7b-47691dd748d7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:39.821619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-055e0aa2-31bb-4b5f-aa7b-47691dd748d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:39.924225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 657/1331] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:39.961108 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7adbd-b708-45b0-939e-cdf667c6ce1e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:39.962670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c5d7adbd-b708-45b0-939e-cdf667c6ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:40.067006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7adbd-b708-45b0-939e-cdf667c6ce1e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:40.145668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7e959-1c70-425c-bb63-1528a6eb5c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:40.146339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7e959-1c70-425c-bb63-1528a6eb5c34 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:40.146620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7e959-1c70-425c-bb63-1528a6eb5c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:40.146896 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7e959-1c70-425c-bb63-1528a6eb5c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:40.148598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-99a7e959-1c70-425c-bb63-1528a6eb5c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:40.266743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7e959-1c70-425c-bb63-1528a6eb5c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:40.268207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7e959-1c70-425c-bb63-1528a6eb5c34 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:40.290148 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 675/1332] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:42.775022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e35c31-9ce3-4e00-ab46-7e931de421bd None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:42.775606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e35c31-9ce3-4e00-ab46-7e931de421bd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:42.775606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e35c31-9ce3-4e00-ab46-7e931de421bd None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:42.776953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 658/1333] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:42.783044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a4c9-e5a4-47bd-a40c-7c7cf6de2c32 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:42.783506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a4c9-e5a4-47bd-a40c-7c7cf6de2c32 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:42.783613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85a4c9-e5a4-47bd-a40c-7c7cf6de2c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:42.847679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2d85a4c9-e5a4-47bd-a40c-7c7cf6de2c32 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:42.848884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2d85a4c9-e5a4-47bd-a40c-7c7cf6de2c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:42.961134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 676/1334] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:43.002871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e35c31-9ce3-4e00-ab46-7e931de421bd None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:43.004406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b7e35c31-9ce3-4e00-ab46-7e931de421bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:43.112310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e35c31-9ce3-4e00-ab46-7e931de421bd None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:43.192702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472a52a-901b-47d4-affa-25fcd37ff4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:43.193357 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472a52a-901b-47d4-affa-25fcd37ff4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:43.193667 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472a52a-901b-47d4-affa-25fcd37ff4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:43.193942 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472a52a-901b-47d4-affa-25fcd37ff4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:43.195595 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a472a52a-901b-47d4-affa-25fcd37ff4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:43.307274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472a52a-901b-47d4-affa-25fcd37ff4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:43.308663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472a52a-901b-47d4-affa-25fcd37ff4d4 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:43.327042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 659/1335] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:46.003106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75b684-14a5-4a94-95ca-d03057742d15 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:46.003644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75b684-14a5-4a94-95ca-d03057742d15 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:46.003644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75b684-14a5-4a94-95ca-d03057742d15 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:46.005148 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 677/1336] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:46.011809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d238900-ac58-477a-a9e6-13e273ac36f5 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:46.012318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d238900-ac58-477a-a9e6-13e273ac36f5 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:46.012410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d238900-ac58-477a-a9e6-13e273ac36f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:46.084448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3d238900-ac58-477a-a9e6-13e273ac36f5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:46.085705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3d238900-ac58-477a-a9e6-13e273ac36f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:46.186346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 660/1337] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:46.222491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75b684-14a5-4a94-95ca-d03057742d15 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:46.224046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0e75b684-14a5-4a94-95ca-d03057742d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:46.329602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75b684-14a5-4a94-95ca-d03057742d15 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:46.404439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe95dd3-ce66-41bc-9357-4fc9f23cd5a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:46.405095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe95dd3-ce66-41bc-9357-4fc9f23cd5a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:46.405373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe95dd3-ce66-41bc-9357-4fc9f23cd5a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:46.406226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe95dd3-ce66-41bc-9357-4fc9f23cd5a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:46.408146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bfe95dd3-ce66-41bc-9357-4fc9f23cd5a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:46.525141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe95dd3-ce66-41bc-9357-4fc9f23cd5a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:46.526615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe95dd3-ce66-41bc-9357-4fc9f23cd5a2 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:46.545309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 678/1338] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:50.974870 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746b00a-1cc0-4db6-b680-d18b4740b055 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:50.975404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746b00a-1cc0-4db6-b680-d18b4740b055 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:50.975404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746b00a-1cc0-4db6-b680-d18b4740b055 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:50.976791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 661/1339] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:50.982186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc18461-f19f-4c4f-bc6e-a33ffb4abf06 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:50.982673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc18461-f19f-4c4f-bc6e-a33ffb4abf06 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:50.982793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc18461-f19f-4c4f-bc6e-a33ffb4abf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:51.067106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5fc18461-f19f-4c4f-bc6e-a33ffb4abf06 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:51.068327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5fc18461-f19f-4c4f-bc6e-a33ffb4abf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:51.180369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 679/1340] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:46:51.222319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746b00a-1cc0-4db6-b680-d18b4740b055 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:51.229955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d746b00a-1cc0-4db6-b680-d18b4740b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:51.335637 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746b00a-1cc0-4db6-b680-d18b4740b055 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:51.339322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b367da3-f639-47a0-b24d-5e593701e3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:51.339981 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b367da3-f639-47a0-b24d-5e593701e3ec service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:51.340263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b367da3-f639-47a0-b24d-5e593701e3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:51.340539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b367da3-f639-47a0-b24d-5e593701e3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:51.351728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b367da3-f639-47a0-b24d-5e593701e3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:51.352869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b367da3-f639-47a0-b24d-5e593701e3ec service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:51.364288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 662/1341] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:46:54.420055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583a2a7-8c22-4fbe-9e39-0069cac8ef9a None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:54.420595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583a2a7-8c22-4fbe-9e39-0069cac8ef9a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:54.420595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583a2a7-8c22-4fbe-9e39-0069cac8ef9a None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:54.422623 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 680/1342] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:54.428480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4fe42-9717-4157-8ceb-bb23775c796f None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:54.429011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4fe42-9717-4157-8ceb-bb23775c796f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:54.429011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4fe42-9717-4157-8ceb-bb23775c796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:54.458746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e3c4fe42-9717-4157-8ceb-bb23775c796f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:54.459943 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e3c4fe42-9717-4157-8ceb-bb23775c796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:54.541851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 663/1343] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:46:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:46:54.599411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b8a06-743a-44d8-b461-cd439cade070 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:54.599705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b8a06-743a-44d8-b461-cd439cade070 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:54.600056 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b8a06-743a-44d8-b461-cd439cade070 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:54.601544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 681/1344] 10.222.0.23 () {54 vars in 963 bytes} [Wed Apr 6 12:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:46:54.608325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67baf7-e890-46d5-9997-d0f9f15e4aa2 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:54.608670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67baf7-e890-46d5-9997-d0f9f15e4aa2 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:54.609650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67baf7-e890-46d5-9997-d0f9f15e4aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:54.675437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-4f67baf7-e890-46d5-9997-d0f9f15e4aa2 None None] MFA Rules not processed for user `7bd327cdfe2c4f729252d86838aae638`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:46:54.676631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4f67baf7-e890-46d5-9997-d0f9f15e4aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:46:54.683299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 664/1345] 10.222.0.23 () {58 vars in 1060 bytes} [Wed Apr 6 12:46:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:46:54.693197 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b8a06-743a-44d8-b461-cd439cade070 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:46:54.707186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b8a06-743a-44d8-b461-cd439cade070 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:46:54.710770 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675f7d5-cd16-4898-ac0e-3033cb57f0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:46:54.711480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675f7d5-cd16-4898-ac0e-3033cb57f0fe service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:46:54.711776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675f7d5-cd16-4898-ac0e-3033cb57f0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:46:54.712149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675f7d5-cd16-4898-ac0e-3033cb57f0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:46:54.722352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675f7d5-cd16-4898-ac0e-3033cb57f0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:46:54.723893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675f7d5-cd16-4898-ac0e-3033cb57f0fe service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:46:54.735578 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 682/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:46:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:00.241504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0499-ed55-4838-bed8-b733498d76ae None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:00.242144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0499-ed55-4838-bed8-b733498d76ae None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:00.242144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0499-ed55-4838-bed8-b733498d76ae None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:00.243457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 665/1347] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:00.248992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353571c-3035-4889-ac55-ffd1716f9ddc None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:00.250208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353571c-3035-4889-ac55-ffd1716f9ddc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:00.250208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353571c-3035-4889-ac55-ffd1716f9ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:00.269000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e353571c-3035-4889-ac55-ffd1716f9ddc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:00.270254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e353571c-3035-4889-ac55-ffd1716f9ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:00.278541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 683/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:00.319664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d0499-ed55-4838-bed8-b733498d76ae None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:00.334134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d0499-ed55-4838-bed8-b733498d76ae None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:00.337815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810af023-3f16-4913-a324-154f4c0b9e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:00.338471 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810af023-3f16-4913-a324-154f4c0b9e74 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:00.338749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810af023-3f16-4913-a324-154f4c0b9e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:00.339017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810af023-3f16-4913-a324-154f4c0b9e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:00.349392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810af023-3f16-4913-a324-154f4c0b9e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:00.350165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810af023-3f16-4913-a324-154f4c0b9e74 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:00.360774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 666/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:06.018694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12cf3c-9a9a-4b09-bf51-12ed4d0ee231 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:06.019600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12cf3c-9a9a-4b09-bf51-12ed4d0ee231 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:06.020029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce12cf3c-9a9a-4b09-bf51-12ed4d0ee231 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:06.021899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 684/1350] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 12:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:06.027456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca1b09-5310-4a2f-a192-b2b3a7f1ccd1 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:06.028300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca1b09-5310-4a2f-a192-b2b3a7f1ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:06.028731 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca1b09-5310-4a2f-a192-b2b3a7f1ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:06.081261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-87ca1b09-5310-4a2f-a192-b2b3a7f1ccd1 None None] MFA Rules not processed for user `221dab3ebc4f4c68b253729391e9c503`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:06.082776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-87ca1b09-5310-4a2f-a192-b2b3a7f1ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:06.167710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 667/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 12:47:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:47:10.704619 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3f14-7e05-455a-a7b3-ef4454adfcef None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:10.705483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3f14-7e05-455a-a7b3-ef4454adfcef None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:10.705969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db3f14-7e05-455a-a7b3-ef4454adfcef None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:10.707353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 685/1352] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 12:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:47:10.712694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9996b74-22b5-4e8b-a8f7-1e37dec3f6b9 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:10.713203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9996b74-22b5-4e8b-a8f7-1e37dec3f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:10.713306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9996b74-22b5-4e8b-a8f7-1e37dec3f6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:10.732645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f9996b74-22b5-4e8b-a8f7-1e37dec3f6b9 None None] MFA Rules not processed for user `221dab3ebc4f4c68b253729391e9c503`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:10.734592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f9996b74-22b5-4e8b-a8f7-1e37dec3f6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:10.743461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 668/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 12:47:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:12.471078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3885672-e5c5-4a86-a66a-3e8505162c68 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:12.471583 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3885672-e5c5-4a86-a66a-3e8505162c68 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:12.471662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3885672-e5c5-4a86-a66a-3e8505162c68 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:12.472971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 686/1354] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 12:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:12.478138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed68c6b-2dc5-4210-819d-53544f8a9fde None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:12.478580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed68c6b-2dc5-4210-819d-53544f8a9fde None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:12.478698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed68c6b-2dc5-4210-819d-53544f8a9fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:12.497680 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-1ed68c6b-2dc5-4210-819d-53544f8a9fde None None] MFA Rules not processed for user `221dab3ebc4f4c68b253729391e9c503`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:12.499667 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1ed68c6b-2dc5-4210-819d-53544f8a9fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:12.508491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 669/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 12:47:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:16.472044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54becc-19c6-4128-924c-b8222dc9c27d None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:16.472544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54becc-19c6-4128-924c-b8222dc9c27d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:16.472544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54becc-19c6-4128-924c-b8222dc9c27d None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:16.473871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 687/1356] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:16.478916 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525bd14-8866-4bf3-87ba-f23ff6726208 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:16.479380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525bd14-8866-4bf3-87ba-f23ff6726208 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:16.479461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525bd14-8866-4bf3-87ba-f23ff6726208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:16.496678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-7525bd14-8866-4bf3-87ba-f23ff6726208 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:16.497809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7525bd14-8866-4bf3-87ba-f23ff6726208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:16.506495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 670/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:16.554912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bce06-70ab-4851-aebc-19c5406cd1d7 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:16.555275 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bce06-70ab-4851-aebc-19c5406cd1d7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:16.555729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bce06-70ab-4851-aebc-19c5406cd1d7 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:16.557232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 688/1358] 10.222.0.23 () {54 vars in 960 bytes} [Wed Apr 6 12:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:16.563123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a00a65-0ef9-478c-a2c7-9d675234297a None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:16.563408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a00a65-0ef9-478c-a2c7-9d675234297a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:16.563702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a00a65-0ef9-478c-a2c7-9d675234297a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:16.612493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b7a00a65-0ef9-478c-a2c7-9d675234297a None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:16.613707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b7a00a65-0ef9-478c-a2c7-9d675234297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:16.698489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 671/1359] 10.222.0.23 () {58 vars in 1057 bytes} [Wed Apr 6 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:16.708946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bce06-70ab-4851-aebc-19c5406cd1d7 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:16.724440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bce06-70ab-4851-aebc-19c5406cd1d7 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:16.730398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5fb65-ce5c-43ee-b13c-e4a917a2a1b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:16.731273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5fb65-ce5c-43ee-b13c-e4a917a2a1b6 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:16.731764 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5fb65-ce5c-43ee-b13c-e4a917a2a1b6 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:16.732262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5fb65-ce5c-43ee-b13c-e4a917a2a1b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:16.741486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5fb65-ce5c-43ee-b13c-e4a917a2a1b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:16.743343 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5fb65-ce5c-43ee-b13c-e4a917a2a1b6 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:16.754231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 689/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:19.362164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06939aef-5712-491a-a42c-7abad7fc7253 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:19.362695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06939aef-5712-491a-a42c-7abad7fc7253 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:19.362695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06939aef-5712-491a-a42c-7abad7fc7253 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:19.364274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 672/1361] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:19.369906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b52a-0bff-4241-b666-f1c6a3d15309 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:19.370371 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b52a-0bff-4241-b666-f1c6a3d15309 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:19.370529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b52a-0bff-4241-b666-f1c6a3d15309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:19.389504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-02c5b52a-0bff-4241-b666-f1c6a3d15309 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:19.390721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-02c5b52a-0bff-4241-b666-f1c6a3d15309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:19.405986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 690/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:19.445433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06939aef-5712-491a-a42c-7abad7fc7253 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:19.460273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06939aef-5712-491a-a42c-7abad7fc7253 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:19.465756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc8704-dc43-47eb-accc-59d14104647a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:19.466405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8704-dc43-47eb-accc-59d14104647a service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:19.466689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8704-dc43-47eb-accc-59d14104647a service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:19.466960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc8704-dc43-47eb-accc-59d14104647a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:19.476077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc8704-dc43-47eb-accc-59d14104647a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:19.477803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc8704-dc43-47eb-accc-59d14104647a service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:19.487776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 673/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:22.098930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86615e0-cc66-42fa-86b0-d5da16dbc536 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:22.099491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86615e0-cc66-42fa-86b0-d5da16dbc536 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:22.099491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86615e0-cc66-42fa-86b0-d5da16dbc536 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:22.100889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 691/1364] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:22.107069 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e059f6-2244-49ec-b084-c54148aaa0b4 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:22.107985 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e059f6-2244-49ec-b084-c54148aaa0b4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:22.109081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e059f6-2244-49ec-b084-c54148aaa0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:22.138093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-03e059f6-2244-49ec-b084-c54148aaa0b4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:22.139859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-03e059f6-2244-49ec-b084-c54148aaa0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:22.148423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 674/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:22.196224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcce9b-03b4-48fa-b8ba-1658a8e386da None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:22.196592 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcce9b-03b4-48fa-b8ba-1658a8e386da None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:22.196957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcce9b-03b4-48fa-b8ba-1658a8e386da None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:22.198430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 692/1366] 10.222.0.23 () {54 vars in 960 bytes} [Wed Apr 6 12:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:22.204328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1d69-ec99-4345-97e3-e217a2a517fd None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:22.204618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1d69-ec99-4345-97e3-e217a2a517fd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:22.204970 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa1d69-ec99-4345-97e3-e217a2a517fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:22.224129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-08fa1d69-ec99-4345-97e3-e217a2a517fd None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:22.225316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-08fa1d69-ec99-4345-97e3-e217a2a517fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:22.234636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 675/1367] 10.222.0.23 () {58 vars in 1057 bytes} [Wed Apr 6 12:47:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:22.242538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcce9b-03b4-48fa-b8ba-1658a8e386da None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:22.256596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcce9b-03b4-48fa-b8ba-1658a8e386da None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:22.262212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04638e-2295-42fa-8a82-98f75ae14918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:22.262841 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04638e-2295-42fa-8a82-98f75ae14918 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:22.263122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04638e-2295-42fa-8a82-98f75ae14918 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:22.263392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04638e-2295-42fa-8a82-98f75ae14918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:22.272487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04638e-2295-42fa-8a82-98f75ae14918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:22.274089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04638e-2295-42fa-8a82-98f75ae14918 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:22.284115 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 693/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:24.711297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b7070-35d1-4ae3-a902-4013b81870ce None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:24.711823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b7070-35d1-4ae3-a902-4013b81870ce None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:24.711823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b7070-35d1-4ae3-a902-4013b81870ce None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:24.713124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 676/1369] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:24.719710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbabce8-a400-4fe8-8389-4f9e3a15e533 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:24.720212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbabce8-a400-4fe8-8389-4f9e3a15e533 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:24.720325 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbabce8-a400-4fe8-8389-4f9e3a15e533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:24.737958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-8fbabce8-a400-4fe8-8389-4f9e3a15e533 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:24.739168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8fbabce8-a400-4fe8-8389-4f9e3a15e533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:24.747467 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 694/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:24.795632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b7070-35d1-4ae3-a902-4013b81870ce None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:24.814148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b7070-35d1-4ae3-a902-4013b81870ce None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:24.819838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f583c04-bfec-477b-afdd-c933065b9fa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:24.820506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583c04-bfec-477b-afdd-c933065b9fa5 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:24.820790 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583c04-bfec-477b-afdd-c933065b9fa5 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:24.821068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f583c04-bfec-477b-afdd-c933065b9fa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:24.831086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f583c04-bfec-477b-afdd-c933065b9fa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:24.832994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f583c04-bfec-477b-afdd-c933065b9fa5 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:24.844478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 677/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:24.990371 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5296ee3-0184-4150-a5cd-98492086ae60 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:24.990720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5296ee3-0184-4150-a5cd-98492086ae60 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:24.991097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5296ee3-0184-4150-a5cd-98492086ae60 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:24.992734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 695/1372] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:24.998825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297bdf4-73e2-448c-8f62-4ececc0a1a22 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:24.999322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297bdf4-73e2-448c-8f62-4ececc0a1a22 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:24.999774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297bdf4-73e2-448c-8f62-4ececc0a1a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:25.020328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b297bdf4-73e2-448c-8f62-4ececc0a1a22 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:25.021609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b297bdf4-73e2-448c-8f62-4ececc0a1a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:25.030882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 678/1373] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:25.354939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd50d31-31da-4d22-833b-ff585e21da35 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:25.354939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd50d31-31da-4d22-833b-ff585e21da35 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:25.357650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd50d31-31da-4d22-833b-ff585e21da35 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:25.358608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 696/1374] 10.222.0.23 () {54 vars in 962 bytes} [Wed Apr 6 12:47:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:25.363585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59639e5-1008-40f3-af30-0cd52b9717b8 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:25.364152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59639e5-1008-40f3-af30-0cd52b9717b8 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:25.364645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59639e5-1008-40f3-af30-0cd52b9717b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:25.424377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c59639e5-1008-40f3-af30-0cd52b9717b8 None None] MFA Rules not processed for user `7277fd0f4cf64df4aaa65d7743b99028`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:25.425978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c59639e5-1008-40f3-af30-0cd52b9717b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:25.492602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 679/1375] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Apr 6 12:47:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:47:25.501011 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd50d31-31da-4d22-833b-ff585e21da35 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:25.513272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd50d31-31da-4d22-833b-ff585e21da35 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:25.517436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ac2d8-59cd-4b1e-a155-c3260f7e8869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:25.518524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac2d8-59cd-4b1e-a155-c3260f7e8869 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:25.519010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac2d8-59cd-4b1e-a155-c3260f7e8869 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:25.519482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ac2d8-59cd-4b1e-a155-c3260f7e8869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:25.530648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ac2d8-59cd-4b1e-a155-c3260f7e8869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:25.532729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ac2d8-59cd-4b1e-a155-c3260f7e8869 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:25.547676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 697/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:27.291109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f4a80-6672-4a62-93a0-0512c352bd2d None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:27.291640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f4a80-6672-4a62-93a0-0512c352bd2d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:27.291640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f4a80-6672-4a62-93a0-0512c352bd2d None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:27.293025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 680/1377] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:27.299116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdc78c-9601-42a8-b19a-72c11bf7c5e3 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:27.299620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdc78c-9601-42a8-b19a-72c11bf7c5e3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:27.299783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdc78c-9601-42a8-b19a-72c11bf7c5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:27.319600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3cbdc78c-9601-42a8-b19a-72c11bf7c5e3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:27.320914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3cbdc78c-9601-42a8-b19a-72c11bf7c5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:27.333105 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 698/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:27.381311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f4a80-6672-4a62-93a0-0512c352bd2d None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:27.396243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f4a80-6672-4a62-93a0-0512c352bd2d None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:27.401910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec721d18-cfbf-4f97-92f6-9aad2951c019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:27.402582 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721d18-cfbf-4f97-92f6-9aad2951c019 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:27.402861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721d18-cfbf-4f97-92f6-9aad2951c019 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:27.403132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721d18-cfbf-4f97-92f6-9aad2951c019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:27.412284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec721d18-cfbf-4f97-92f6-9aad2951c019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:27.414032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec721d18-cfbf-4f97-92f6-9aad2951c019 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:27.425501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 681/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:29.798881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb0079-8fe7-45db-8934-2df373e4eb61 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:29.799910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb0079-8fe7-45db-8934-2df373e4eb61 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:29.800408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb0079-8fe7-45db-8934-2df373e4eb61 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:29.802304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 699/1380] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:29.807059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725816c5-880a-4a12-9afd-03070aa3acb3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:29.807465 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725816c5-880a-4a12-9afd-03070aa3acb3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:29.807630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725816c5-880a-4a12-9afd-03070aa3acb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:29.825905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-725816c5-880a-4a12-9afd-03070aa3acb3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:29.827616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-725816c5-880a-4a12-9afd-03070aa3acb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:29.835505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 682/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:29.889869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb0079-8fe7-45db-8934-2df373e4eb61 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:29.907177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb0079-8fe7-45db-8934-2df373e4eb61 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:29.912747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893b3b3-2ea3-44b1-87b2-fe4c6cf74863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:29.913495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b3b3-2ea3-44b1-87b2-fe4c6cf74863 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:29.914057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b3b3-2ea3-44b1-87b2-fe4c6cf74863 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:29.914435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b3b3-2ea3-44b1-87b2-fe4c6cf74863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:29.923642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893b3b3-2ea3-44b1-87b2-fe4c6cf74863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:29.925458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893b3b3-2ea3-44b1-87b2-fe4c6cf74863 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:29.935949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 700/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:32.301721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9cad9-037e-4262-929d-a048a19b28c4 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:32.302258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9cad9-037e-4262-929d-a048a19b28c4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:32.302258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9cad9-037e-4262-929d-a048a19b28c4 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:32.303627 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 683/1383] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:32.308694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195a211-95ea-468a-ae92-5afc966081b4 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:32.309481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195a211-95ea-468a-ae92-5afc966081b4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:32.309843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195a211-95ea-468a-ae92-5afc966081b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:32.332126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3195a211-95ea-468a-ae92-5afc966081b4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:32.333602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3195a211-95ea-468a-ae92-5afc966081b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:32.343777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 701/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:32.386945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9cad9-037e-4262-929d-a048a19b28c4 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:32.401259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9cad9-037e-4262-929d-a048a19b28c4 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:32.408080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a454be4-9756-4de1-97c8-4a6d7face4f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:32.408855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a454be4-9756-4de1-97c8-4a6d7face4f2 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:32.409233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a454be4-9756-4de1-97c8-4a6d7face4f2 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:32.409629 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a454be4-9756-4de1-97c8-4a6d7face4f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:32.418289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a454be4-9756-4de1-97c8-4a6d7face4f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:32.420010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a454be4-9756-4de1-97c8-4a6d7face4f2 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:32.431152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 684/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:34.831012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c8de7-a343-41a0-a74f-4f34aa27d29a None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:34.831766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c8de7-a343-41a0-a74f-4f34aa27d29a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:34.831766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c8de7-a343-41a0-a74f-4f34aa27d29a None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:34.832946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 702/1386] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:34.838456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d011f6-24a4-4fb0-8735-cddcbf770ba8 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:34.838913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d011f6-24a4-4fb0-8735-cddcbf770ba8 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:34.839037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d011f6-24a4-4fb0-8735-cddcbf770ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:34.857294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-84d011f6-24a4-4fb0-8735-cddcbf770ba8 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:34.859278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-84d011f6-24a4-4fb0-8735-cddcbf770ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:34.869557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 685/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:34.915303 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c8de7-a343-41a0-a74f-4f34aa27d29a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:34.930160 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c8de7-a343-41a0-a74f-4f34aa27d29a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:34.935677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2094b11-0478-45e7-a7f0-7d04776a8d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:34.937022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2094b11-0478-45e7-a7f0-7d04776a8d10 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:34.937363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2094b11-0478-45e7-a7f0-7d04776a8d10 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:34.937673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2094b11-0478-45e7-a7f0-7d04776a8d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:34.946668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2094b11-0478-45e7-a7f0-7d04776a8d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:34.948339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2094b11-0478-45e7-a7f0-7d04776a8d10 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:34.958892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 703/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:37.319417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a828c-c108-4790-9666-2f85726fbff7 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:37.320035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a828c-c108-4790-9666-2f85726fbff7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:37.320169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a828c-c108-4790-9666-2f85726fbff7 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:37.322045 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 686/1389] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:37.328941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3958a2-c25d-45a5-9d46-91b1e166b604 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:37.329415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3958a2-c25d-45a5-9d46-91b1e166b604 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:37.329507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3958a2-c25d-45a5-9d46-91b1e166b604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:37.350911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-ba3958a2-c25d-45a5-9d46-91b1e166b604 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:37.352167 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-ba3958a2-c25d-45a5-9d46-91b1e166b604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:37.361090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 704/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:37.406975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a828c-c108-4790-9666-2f85726fbff7 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:37.421723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a828c-c108-4790-9666-2f85726fbff7 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:37.427952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67cd13-8f5f-4081-b099-cac16ac4f46e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:37.428831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67cd13-8f5f-4081-b099-cac16ac4f46e service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:37.429196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67cd13-8f5f-4081-b099-cac16ac4f46e service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:37.429555 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67cd13-8f5f-4081-b099-cac16ac4f46e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:37.446070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67cd13-8f5f-4081-b099-cac16ac4f46e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:37.447775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd67cd13-8f5f-4081-b099-cac16ac4f46e service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:37.457853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 687/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:47:40.106272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eb6a2-b8ca-4e74-b57b-e01efbd63698 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:40.106932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eb6a2-b8ca-4e74-b57b-e01efbd63698 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:40.106932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eb6a2-b8ca-4e74-b57b-e01efbd63698 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:40.108949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 705/1392] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:40.114482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7f5e-5cf2-4931-bc03-d2d93ec3f562 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:40.114954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7f5e-5cf2-4931-bc03-d2d93ec3f562 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:40.115060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b7f5e-5cf2-4931-bc03-d2d93ec3f562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:40.132829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d48b7f5e-5cf2-4931-bc03-d2d93ec3f562 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:40.134063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d48b7f5e-5cf2-4931-bc03-d2d93ec3f562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:40.142753 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 688/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:40.188232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eb6a2-b8ca-4e74-b57b-e01efbd63698 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:40.203212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eb6a2-b8ca-4e74-b57b-e01efbd63698 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:40.208942 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d70cbd-c391-4b12-9870-37e64024aec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:40.209605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70cbd-c391-4b12-9870-37e64024aec4 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:40.209894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70cbd-c391-4b12-9870-37e64024aec4 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:40.210208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d70cbd-c391-4b12-9870-37e64024aec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:40.219385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d70cbd-c391-4b12-9870-37e64024aec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:40.220976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d70cbd-c391-4b12-9870-37e64024aec4 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:40.230521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 706/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:41.768721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b06c5-c03d-4d68-813a-687d76c99748 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:41.769307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b06c5-c03d-4d68-813a-687d76c99748 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:41.769410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b06c5-c03d-4d68-813a-687d76c99748 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:41.770862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 689/1395] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:41.776355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1a437-e00f-4c8b-868e-368bbcfbcd1b None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:41.776855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1a437-e00f-4c8b-868e-368bbcfbcd1b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:41.777020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1a437-e00f-4c8b-868e-368bbcfbcd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:41.795969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-46a1a437-e00f-4c8b-868e-368bbcfbcd1b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:41.797438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-46a1a437-e00f-4c8b-868e-368bbcfbcd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:41.805444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 707/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:41.864092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a3e7-5795-420e-bf2a-c9438964c968 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:41.864381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a3e7-5795-420e-bf2a-c9438964c968 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:41.864665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9a3e7-5795-420e-bf2a-c9438964c968 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:41.866077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 690/1397] 10.222.0.23 () {54 vars in 961 bytes} [Wed Apr 6 12:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:41.871211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28997882-7554-47cd-81fb-5ae1679d1879 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:41.871635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28997882-7554-47cd-81fb-5ae1679d1879 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:41.871916 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28997882-7554-47cd-81fb-5ae1679d1879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:41.922552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-28997882-7554-47cd-81fb-5ae1679d1879 None None] MFA Rules not processed for user `7330a81c0f3a496ea29ae911fcc69221`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:41.923772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-28997882-7554-47cd-81fb-5ae1679d1879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:41.982969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 708/1398] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Apr 6 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:41.990462 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a3e7-5795-420e-bf2a-c9438964c968 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:42.001311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9a3e7-5795-420e-bf2a-c9438964c968 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:42.004784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd12cc-ed5d-4cf5-8407-b8033ff1e5e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7330a81c0f3a496ea29ae911fcc69221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:42.005417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd12cc-ed5d-4cf5-8407-b8033ff1e5e5 service glance] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:42.005738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd12cc-ed5d-4cf5-8407-b8033ff1e5e5 service glance] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:42.006011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd12cc-ed5d-4cf5-8407-b8033ff1e5e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:42.016036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd12cc-ed5d-4cf5-8407-b8033ff1e5e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:42.017494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd12cc-ed5d-4cf5-8407-b8033ff1e5e5 service glance] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:42.027156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 691/1399] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:47:42.465705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb54a-33ad-42d3-842f-745ef6954a0f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:42.466111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb54a-33ad-42d3-842f-745ef6954a0f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:42.466475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb54a-33ad-42d3-842f-745ef6954a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:42.515292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b78eb54a-33ad-42d3-842f-745ef6954a0f None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:42.516487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b78eb54a-33ad-42d3-842f-745ef6954a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:42.580656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 709/1400] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:42.622038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173d2b2-829f-4058-9040-cabd7c232740 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:42.622334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173d2b2-829f-4058-9040-cabd7c232740 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:42.622613 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173d2b2-829f-4058-9040-cabd7c232740 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:42.625092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 692/1401] 10.222.0.23 () {54 vars in 942 bytes} [Wed Apr 6 12:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:42.631210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d348478-6e84-47f5-ae8a-8425cba2061a None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:42.631665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d348478-6e84-47f5-ae8a-8425cba2061a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:42.631948 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d348478-6e84-47f5-ae8a-8425cba2061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:42.680888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-9d348478-6e84-47f5-ae8a-8425cba2061a None None] MFA Rules not processed for user `0118661184dc4cb198f65e831fb1fe8f`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:42.682104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9d348478-6e84-47f5-ae8a-8425cba2061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:42.703062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e109a0-411c-499a-b63c-21fd7ae85c94 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:42.703374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e109a0-411c-499a-b63c-21fd7ae85c94 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:42.703659 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e109a0-411c-499a-b63c-21fd7ae85c94 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:42.705050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 693/1402] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:47:42.710714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced804-69aa-4ea2-b7c9-23bde1cde01c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:42.711010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced804-69aa-4ea2-b7c9-23bde1cde01c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:42.711294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbced804-69aa-4ea2-b7c9-23bde1cde01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:42.729004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-fbced804-69aa-4ea2-b7c9-23bde1cde01c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:42.730267 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-fbced804-69aa-4ea2-b7c9-23bde1cde01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:42.739282 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 694/1403] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:47:42.755833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 710/1404] 10.222.0.23 () {58 vars in 1039 bytes} [Wed Apr 6 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:47:42.764532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbced804-69aa-4ea2-b7c9-23bde1cde01c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:42.778299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbced804-69aa-4ea2-b7c9-23bde1cde01c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:42.784304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb23b2-e9a1-4dd3-9948-f73cb2c2308d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:42.784960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb23b2-e9a1-4dd3-9948-f73cb2c2308d service swift] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:42.785242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb23b2-e9a1-4dd3-9948-f73cb2c2308d service swift] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:42.785528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb23b2-e9a1-4dd3-9948-f73cb2c2308d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:42.789260 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d348478-6e84-47f5-ae8a-8425cba2061a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:42.794370 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb23b2-e9a1-4dd3-9948-f73cb2c2308d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:42.796742 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb23b2-e9a1-4dd3-9948-f73cb2c2308d service swift] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:42.802192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d348478-6e84-47f5-ae8a-8425cba2061a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:42.805429 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 695/1405] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 12:47:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 12:47:42.811754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76a3cf-51c4-4d10-a0e0-342b50900284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:42.812264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76a3cf-51c4-4d10-a0e0-342b50900284 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:42.812543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76a3cf-51c4-4d10-a0e0-342b50900284 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:42.812863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76a3cf-51c4-4d10-a0e0-342b50900284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:42.821851 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76a3cf-51c4-4d10-a0e0-342b50900284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:42.823494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76a3cf-51c4-4d10-a0e0-342b50900284 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:42.835365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 711/1406] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:47:45.271727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79b80c-1e2b-4f88-9ba2-e9051fc2ddff None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:45.272268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79b80c-1e2b-4f88-9ba2-e9051fc2ddff None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:45.272268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79b80c-1e2b-4f88-9ba2-e9051fc2ddff None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:45.273986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 696/1407] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:47:45.278838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcf68a-d4ff-4bf6-b023-03dd0cb5bf6f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:45.279804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcf68a-d4ff-4bf6-b023-03dd0cb5bf6f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:45.280081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcf68a-d4ff-4bf6-b023-03dd0cb5bf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:45.300135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-9ddcf68a-d4ff-4bf6-b023-03dd0cb5bf6f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:47:45.300768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9ddcf68a-d4ff-4bf6-b023-03dd0cb5bf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:47:45.308723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 712/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:47:45.357219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79b80c-1e2b-4f88-9ba2-e9051fc2ddff None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:47:45.374216 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79b80c-1e2b-4f88-9ba2-e9051fc2ddff None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:47:45.379906 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb651f5b-9c71-450b-a5a1-28a4e67d9278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:47:45.380584 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651f5b-9c71-450b-a5a1-28a4e67d9278 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:47:45.380868 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651f5b-9c71-450b-a5a1-28a4e67d9278 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:47:45.381148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651f5b-9c71-450b-a5a1-28a4e67d9278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:47:45.391381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb651f5b-9c71-450b-a5a1-28a4e67d9278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:47:45.392994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb651f5b-9c71-450b-a5a1-28a4e67d9278 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:47:45.403336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 697/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:06.211152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da1cfe-8be8-4108-a92f-32e02d634573 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:06.211820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da1cfe-8be8-4108-a92f-32e02d634573 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:06.211820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da1cfe-8be8-4108-a92f-32e02d634573 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:06.213187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 713/1410] 10.222.0.23 () {54 vars in 918 bytes} [Wed Apr 6 12:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:06.219307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a9eb6-3153-4d3e-8162-6a76cdf02dbb None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:06.219809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a9eb6-3153-4d3e-8162-6a76cdf02dbb None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:06.219913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a9eb6-3153-4d3e-8162-6a76cdf02dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:06.237258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-875a9eb6-3153-4d3e-8162-6a76cdf02dbb None None] MFA Rules not processed for user `221dab3ebc4f4c68b253729391e9c503`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:06.238482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-875a9eb6-3153-4d3e-8162-6a76cdf02dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:06.247006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 698/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Apr 6 12:48:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:48:06.261781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03171466-6ad2-4b63-bf90-d175296db1de None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:06.262090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03171466-6ad2-4b63-bf90-d175296db1de None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:06.262369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03171466-6ad2-4b63-bf90-d175296db1de None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:06.264429 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 714/1412] 10.222.0.23 () {54 vars in 918 bytes} [Wed Apr 6 12:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:06.269759 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9daac-c1c0-4455-a957-dd714659f959 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:06.270048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9daac-c1c0-4455-a957-dd714659f959 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:06.270325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9daac-c1c0-4455-a957-dd714659f959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:06.288165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-97b9daac-c1c0-4455-a957-dd714659f959 None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:06.289371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-97b9daac-c1c0-4455-a957-dd714659f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:06.298832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 699/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Wed Apr 6 12:48:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:09.195287 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5072ec-7cc7-420c-ada6-9e8143c59dc6 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:09.195863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5072ec-7cc7-420c-ada6-9e8143c59dc6 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:09.195863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5072ec-7cc7-420c-ada6-9e8143c59dc6 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:09.197159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:09.202799 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca9998-4d1b-4d07-8360-1aeeea281a79 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:09.203247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca9998-4d1b-4d07-8360-1aeeea281a79 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:09.203367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca9998-4d1b-4d07-8360-1aeeea281a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:09.221816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-24ca9998-4d1b-4d07-8360-1aeeea281a79 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:09.223029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-24ca9998-4d1b-4d07-8360-1aeeea281a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:09.230809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:09.276025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5072ec-7cc7-420c-ada6-9e8143c59dc6 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:09.290629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5072ec-7cc7-420c-ada6-9e8143c59dc6 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:09.297078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd61ff-8ac4-4eb5-abb6-7a9cb69938ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:09.298018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd61ff-8ac4-4eb5-abb6-7a9cb69938ac service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:09.298302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd61ff-8ac4-4eb5-abb6-7a9cb69938ac service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:09.298577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd61ff-8ac4-4eb5-abb6-7a9cb69938ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:09.307206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd61ff-8ac4-4eb5-abb6-7a9cb69938ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:09.308789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd61ff-8ac4-4eb5-abb6-7a9cb69938ac service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:09.318808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 716/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:10.699830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d9d53-46e2-42c4-b69c-58e2c41d9f93 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:10.700486 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d9d53-46e2-42c4-b69c-58e2c41d9f93 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:10.700486 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d9d53-46e2-42c4-b69c-58e2c41d9f93 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:10.702510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:10.707634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989da64e-64a0-4311-a11f-c2f8963f9bfc None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:10.708103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989da64e-64a0-4311-a11f-c2f8963f9bfc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:10.708205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989da64e-64a0-4311-a11f-c2f8963f9bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:10.726480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-989da64e-64a0-4311-a11f-c2f8963f9bfc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:10.727662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-989da64e-64a0-4311-a11f-c2f8963f9bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:10.736060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:10.901232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d9d53-46e2-42c4-b69c-58e2c41d9f93 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:10.916314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d9d53-46e2-42c4-b69c-58e2c41d9f93 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:10.921850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524306a6-95cd-45ba-beb7-46e36db7f52c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:10.922745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524306a6-95cd-45ba-beb7-46e36db7f52c service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:10.923021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524306a6-95cd-45ba-beb7-46e36db7f52c service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:10.923292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524306a6-95cd-45ba-beb7-46e36db7f52c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:10.931394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524306a6-95cd-45ba-beb7-46e36db7f52c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:10.932984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524306a6-95cd-45ba-beb7-46e36db7f52c service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:10.942410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 702/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:12.300225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844dab4-9b49-4942-ba15-b60eb156a33d None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:12.300831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844dab4-9b49-4942-ba15-b60eb156a33d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:12.300831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844dab4-9b49-4942-ba15-b60eb156a33d None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:12.302211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:12.307883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813dd2-08bf-4964-bda6-7fab60c2a4b8 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:12.308456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813dd2-08bf-4964-bda6-7fab60c2a4b8 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:12.308456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad813dd2-08bf-4964-bda6-7fab60c2a4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:12.329292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-ad813dd2-08bf-4964-bda6-7fab60c2a4b8 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:12.330605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ad813dd2-08bf-4964-bda6-7fab60c2a4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:12.338837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:12.489504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844dab4-9b49-4942-ba15-b60eb156a33d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:12.504533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844dab4-9b49-4942-ba15-b60eb156a33d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:12.509855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab46d69-1952-4ee3-89df-903d65be2114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:12.510486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab46d69-1952-4ee3-89df-903d65be2114 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:12.510768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab46d69-1952-4ee3-89df-903d65be2114 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:12.511078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab46d69-1952-4ee3-89df-903d65be2114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:12.519030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab46d69-1952-4ee3-89df-903d65be2114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:12.520595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab46d69-1952-4ee3-89df-903d65be2114 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:12.529810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 719/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:13.836580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178b80-8a46-497a-b6e8-6b37bac390e8 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:13.837115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178b80-8a46-497a-b6e8-6b37bac390e8 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:13.837115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f178b80-8a46-497a-b6e8-6b37bac390e8 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:13.838421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:13.843320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c301c2-9245-44d1-9e64-f45ae11b291e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:13.843761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c301c2-9245-44d1-9e64-f45ae11b291e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:13.843864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c301c2-9245-44d1-9e64-f45ae11b291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:13.862050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e4c301c2-9245-44d1-9e64-f45ae11b291e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:13.863225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e4c301c2-9245-44d1-9e64-f45ae11b291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:13.870772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:14.019603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178b80-8a46-497a-b6e8-6b37bac390e8 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:14.033308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f178b80-8a46-497a-b6e8-6b37bac390e8 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:14.038762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6626973-9d62-4062-9476-8b434f84ee79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:14.039402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6626973-9d62-4062-9476-8b434f84ee79 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:14.039683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6626973-9d62-4062-9476-8b434f84ee79 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:14.039955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6626973-9d62-4062-9476-8b434f84ee79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:14.048855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6626973-9d62-4062-9476-8b434f84ee79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:14.050522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6626973-9d62-4062-9476-8b434f84ee79 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:14.059784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 705/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:15.438525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f4d94-a6de-4344-9ada-3ba80c4b0aed None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:15.439097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f4d94-a6de-4344-9ada-3ba80c4b0aed None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:15.439097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f4d94-a6de-4344-9ada-3ba80c4b0aed None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:15.440347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:15.447730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3915-ebc6-4607-9d6f-c28b46bf5a83 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:15.448213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3915-ebc6-4607-9d6f-c28b46bf5a83 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:15.448316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3915-ebc6-4607-9d6f-c28b46bf5a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:15.466926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e87a3915-ebc6-4607-9d6f-c28b46bf5a83 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:15.468128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e87a3915-ebc6-4607-9d6f-c28b46bf5a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:15.475820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:15.626187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f4d94-a6de-4344-9ada-3ba80c4b0aed None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:15.640345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f4d94-a6de-4344-9ada-3ba80c4b0aed None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:15.645501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd2c89-51d9-4590-9d7f-4f535850a6eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:15.646156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd2c89-51d9-4590-9d7f-4f535850a6eb service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:15.646438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd2c89-51d9-4590-9d7f-4f535850a6eb service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:15.646709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd2c89-51d9-4590-9d7f-4f535850a6eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:15.654936 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd2c89-51d9-4590-9d7f-4f535850a6eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:15.656522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd2c89-51d9-4590-9d7f-4f535850a6eb service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:15.665928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 722/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:16.933321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01218fd-fead-4880-9384-b5e65dfb2781 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:16.933901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01218fd-fead-4880-9384-b5e65dfb2781 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:16.933901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01218fd-fead-4880-9384-b5e65dfb2781 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:16.935407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:16.940551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e170941-4f6d-4311-8d1c-de76e94ca9ea None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:16.940976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e170941-4f6d-4311-8d1c-de76e94ca9ea None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:16.941085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e170941-4f6d-4311-8d1c-de76e94ca9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:16.958928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5e170941-4f6d-4311-8d1c-de76e94ca9ea None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:16.960113 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5e170941-4f6d-4311-8d1c-de76e94ca9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:16.968822 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:17.121205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01218fd-fead-4880-9384-b5e65dfb2781 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:17.136074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01218fd-fead-4880-9384-b5e65dfb2781 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:17.141967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fb0db-cabb-4da4-ab65-179409ff71fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:17.142604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fb0db-cabb-4da4-ab65-179409ff71fe service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:17.142884 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fb0db-cabb-4da4-ab65-179409ff71fe service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:17.143177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fb0db-cabb-4da4-ab65-179409ff71fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:17.151416 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fb0db-cabb-4da4-ab65-179409ff71fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:17.153007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fb0db-cabb-4da4-ab65-179409ff71fe service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:17.162925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 708/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:18.416245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3768fb-9cfb-4723-87bc-699f6ea0d4b1 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:18.416806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3768fb-9cfb-4723-87bc-699f6ea0d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:18.416806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3768fb-9cfb-4723-87bc-699f6ea0d4b1 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:18.418238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:18.423528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74954a-8ded-47e8-a81b-e32de82cb91f None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:18.423971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74954a-8ded-47e8-a81b-e32de82cb91f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:18.424081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74954a-8ded-47e8-a81b-e32de82cb91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:18.441638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3c74954a-8ded-47e8-a81b-e32de82cb91f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:18.442826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3c74954a-8ded-47e8-a81b-e32de82cb91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:18.451014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:18.601500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3768fb-9cfb-4723-87bc-699f6ea0d4b1 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:18.616066 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3768fb-9cfb-4723-87bc-699f6ea0d4b1 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:18.621203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a30c9-cbad-4d8e-88a0-8bee01cabd4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:18.621896 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a30c9-cbad-4d8e-88a0-8bee01cabd4b service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:18.622801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a30c9-cbad-4d8e-88a0-8bee01cabd4b service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:18.623077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a30c9-cbad-4d8e-88a0-8bee01cabd4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:18.631010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a30c9-cbad-4d8e-88a0-8bee01cabd4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:18.632570 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a30c9-cbad-4d8e-88a0-8bee01cabd4b service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:18.641820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 725/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:19.901241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e0dc-24e0-4c9b-a0a3-eda905201f43 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:19.901879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e0dc-24e0-4c9b-a0a3-eda905201f43 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:19.901879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e0dc-24e0-4c9b-a0a3-eda905201f43 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:19.903231 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:19.908584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f60c-1c3e-4487-83dc-3e56cf1ea324 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:19.908994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f60c-1c3e-4487-83dc-3e56cf1ea324 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:19.909208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f60c-1c3e-4487-83dc-3e56cf1ea324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:19.927584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5158f60c-1c3e-4487-83dc-3e56cf1ea324 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:19.928808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5158f60c-1c3e-4487-83dc-3e56cf1ea324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:19.937034 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:20.098708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e0dc-24e0-4c9b-a0a3-eda905201f43 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:20.113207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e0dc-24e0-4c9b-a0a3-eda905201f43 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:20.118531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758f294-f399-439a-8ca0-83b9f5e2ffc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:20.119157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758f294-f399-439a-8ca0-83b9f5e2ffc8 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:20.119435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758f294-f399-439a-8ca0-83b9f5e2ffc8 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:20.119706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758f294-f399-439a-8ca0-83b9f5e2ffc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:20.128501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758f294-f399-439a-8ca0-83b9f5e2ffc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:20.130134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758f294-f399-439a-8ca0-83b9f5e2ffc8 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:20.139613 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 711/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:21.386474 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5657-a109-4948-82c3-3f975ac1e313 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:21.387038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5657-a109-4948-82c3-3f975ac1e313 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:21.387038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f5657-a109-4948-82c3-3f975ac1e313 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:21.389058 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:48:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:21.394139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c73f-d7e6-475b-962d-82574901e660 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:21.394587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c73f-d7e6-475b-962d-82574901e660 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:21.394721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4c73f-d7e6-475b-962d-82574901e660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:21.412794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d8b4c73f-d7e6-475b-962d-82574901e660 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:21.414031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d8b4c73f-d7e6-475b-962d-82574901e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:21.422642 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:48:21.580962 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5657-a109-4948-82c3-3f975ac1e313 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:21.596507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f5657-a109-4948-82c3-3f975ac1e313 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:21.601834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3d7ea-5a15-4f4b-a6d4-b93b5654b231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:21.602479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d7ea-5a15-4f4b-a6d4-b93b5654b231 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:21.602774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d7ea-5a15-4f4b-a6d4-b93b5654b231 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:21.603104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d7ea-5a15-4f4b-a6d4-b93b5654b231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:21.612703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3d7ea-5a15-4f4b-a6d4-b93b5654b231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:21.614387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3d7ea-5a15-4f4b-a6d4-b93b5654b231 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:21.625757 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 728/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:23.956530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af933ea-4341-4116-8857-a0613c799525 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:23.957086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af933ea-4341-4116-8857-a0613c799525 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:23.957086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af933ea-4341-4116-8857-a0613c799525 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:23.958504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:23.964010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e86aa5-a36e-4cbb-9326-e3201f900acf None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:23.964438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e86aa5-a36e-4cbb-9326-e3201f900acf None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:23.964574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e86aa5-a36e-4cbb-9326-e3201f900acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:23.983402 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-76e86aa5-a36e-4cbb-9326-e3201f900acf None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:23.984606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-76e86aa5-a36e-4cbb-9326-e3201f900acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:23.992436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:24.034278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af933ea-4341-4116-8857-a0613c799525 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:24.046199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af933ea-4341-4116-8857-a0613c799525 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:24.049928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9fc63-4b16-4cc4-bc64-49808319c08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:24.050560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9fc63-4b16-4cc4-bc64-49808319c08d service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:24.050837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9fc63-4b16-4cc4-bc64-49808319c08d service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:24.051107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9fc63-4b16-4cc4-bc64-49808319c08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:24.060472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9fc63-4b16-4cc4-bc64-49808319c08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:24.062554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9fc63-4b16-4cc4-bc64-49808319c08d service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:24.074801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 714/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:26.642839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57d77-6bfb-4137-b2a8-acf067997625 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:26.643405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57d77-6bfb-4137-b2a8-acf067997625 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:26.643405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57d77-6bfb-4137-b2a8-acf067997625 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:26.644666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:26.650265 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cdd97-81aa-4a1e-b36c-5bb29f2eba20 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:26.650709 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cdd97-81aa-4a1e-b36c-5bb29f2eba20 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:26.650813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cdd97-81aa-4a1e-b36c-5bb29f2eba20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:26.668405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-514cdd97-81aa-4a1e-b36c-5bb29f2eba20 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:26.670141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-514cdd97-81aa-4a1e-b36c-5bb29f2eba20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:26.678327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:26.719212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df57d77-6bfb-4137-b2a8-acf067997625 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:26.732767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df57d77-6bfb-4137-b2a8-acf067997625 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:26.736455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1ebe4-c7d9-4c3e-a65e-06797174498b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:26.737097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ebe4-c7d9-4c3e-a65e-06797174498b service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:26.737382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ebe4-c7d9-4c3e-a65e-06797174498b service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:26.737695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1ebe4-c7d9-4c3e-a65e-06797174498b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:26.749646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1ebe4-c7d9-4c3e-a65e-06797174498b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:26.751099 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1ebe4-c7d9-4c3e-a65e-06797174498b service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:26.761725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 731/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:29.406226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73834a7b-1fd2-401c-9ee8-0dd0d5b9e1d6 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:29.406780 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73834a7b-1fd2-401c-9ee8-0dd0d5b9e1d6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:29.406780 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73834a7b-1fd2-401c-9ee8-0dd0d5b9e1d6 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:29.408052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:29.413162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d0d74-1b03-4dd8-9a3b-e291bace6913 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:29.413612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d0d74-1b03-4dd8-9a3b-e291bace6913 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:29.413759 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d0d74-1b03-4dd8-9a3b-e291bace6913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:29.432399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e30d0d74-1b03-4dd8-9a3b-e291bace6913 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:29.433616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e30d0d74-1b03-4dd8-9a3b-e291bace6913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:29.442117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:48:29.483935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73834a7b-1fd2-401c-9ee8-0dd0d5b9e1d6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:29.494400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73834a7b-1fd2-401c-9ee8-0dd0d5b9e1d6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:29.498474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29300a86-e615-436f-b42b-1c20b7f2ef25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:29.499106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29300a86-e615-436f-b42b-1c20b7f2ef25 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:29.499386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29300a86-e615-436f-b42b-1c20b7f2ef25 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:29.499655 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29300a86-e615-436f-b42b-1c20b7f2ef25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:29.508303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29300a86-e615-436f-b42b-1c20b7f2ef25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:29.509789 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29300a86-e615-436f-b42b-1c20b7f2ef25 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:29.519528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 717/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:31.973316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1db9e1-3ef2-4cbc-991b-4cfda3c58c99 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:31.973940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1db9e1-3ef2-4cbc-991b-4cfda3c58c99 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:31.973940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1db9e1-3ef2-4cbc-991b-4cfda3c58c99 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:31.975299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:31.980487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971cc68-0c28-4ae4-9141-85f4b77e280b None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:31.980944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971cc68-0c28-4ae4-9141-85f4b77e280b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:31.981074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971cc68-0c28-4ae4-9141-85f4b77e280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:31.998493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3971cc68-0c28-4ae4-9141-85f4b77e280b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:31.999701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3971cc68-0c28-4ae4-9141-85f4b77e280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:32.007465 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:32.049207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1db9e1-3ef2-4cbc-991b-4cfda3c58c99 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:32.059891 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1db9e1-3ef2-4cbc-991b-4cfda3c58c99 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:32.064330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47294437-3cea-4a8a-b793-620371e9c041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:32.065053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47294437-3cea-4a8a-b793-620371e9c041 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:32.065375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47294437-3cea-4a8a-b793-620371e9c041 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:32.065748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47294437-3cea-4a8a-b793-620371e9c041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:32.075694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47294437-3cea-4a8a-b793-620371e9c041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:32.077119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47294437-3cea-4a8a-b793-620371e9c041 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:32.086728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 734/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:34.571731 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f135667-8874-43a1-8853-a237070bf335 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:34.572304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f135667-8874-43a1-8853-a237070bf335 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:34.572304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f135667-8874-43a1-8853-a237070bf335 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:34.573664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:34.580357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82484042-6e58-46b2-aab5-940f9adfb26c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:34.580816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82484042-6e58-46b2-aab5-940f9adfb26c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:34.580932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82484042-6e58-46b2-aab5-940f9adfb26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:34.599050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-82484042-6e58-46b2-aab5-940f9adfb26c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:34.600184 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-82484042-6e58-46b2-aab5-940f9adfb26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:34.608552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:48:34.647166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f135667-8874-43a1-8853-a237070bf335 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:34.658425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f135667-8874-43a1-8853-a237070bf335 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:34.661979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220dce8-2714-451a-9a40-e2387f2032dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:34.662619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220dce8-2714-451a-9a40-e2387f2032dc service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:34.662900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220dce8-2714-451a-9a40-e2387f2032dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:34.663174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220dce8-2714-451a-9a40-e2387f2032dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:34.673434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220dce8-2714-451a-9a40-e2387f2032dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:34.674955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220dce8-2714-451a-9a40-e2387f2032dc service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:34.686877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 720/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:37.039771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a447-fca2-4a8e-a393-c440523467b3 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:37.040392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a447-fca2-4a8e-a393-c440523467b3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:37.040392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878a447-fca2-4a8e-a393-c440523467b3 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:37.041738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:37.048110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3f1f-1c97-4a81-a35b-d2dd2915abf3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:37.048617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3f1f-1c97-4a81-a35b-d2dd2915abf3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:37.048712 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c3f1f-1c97-4a81-a35b-d2dd2915abf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:37.068283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-de7c3f1f-1c97-4a81-a35b-d2dd2915abf3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:37.069856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-de7c3f1f-1c97-4a81-a35b-d2dd2915abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:37.078758 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:37.117705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878a447-fca2-4a8e-a393-c440523467b3 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:37.129395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878a447-fca2-4a8e-a393-c440523467b3 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:37.132911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e9906-6cb9-4af6-aa81-cfb3eb7fb3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:37.133550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9906-6cb9-4af6-aa81-cfb3eb7fb3eb service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:37.133868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9906-6cb9-4af6-aa81-cfb3eb7fb3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:37.134142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e9906-6cb9-4af6-aa81-cfb3eb7fb3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:37.144124 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e9906-6cb9-4af6-aa81-cfb3eb7fb3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:37.145587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e9906-6cb9-4af6-aa81-cfb3eb7fb3eb service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:37.155403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 737/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:39.539064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190cc9a-0e99-4723-a7b9-c7f4dd7b9a76 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:39.539614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190cc9a-0e99-4723-a7b9-c7f4dd7b9a76 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:39.539614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190cc9a-0e99-4723-a7b9-c7f4dd7b9a76 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:39.540979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:39.546512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca1955-62bf-4b2d-a38e-48b3063e5277 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:39.547026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca1955-62bf-4b2d-a38e-48b3063e5277 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:39.547123 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca1955-62bf-4b2d-a38e-48b3063e5277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:39.565834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-26ca1955-62bf-4b2d-a38e-48b3063e5277 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:39.567031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-26ca1955-62bf-4b2d-a38e-48b3063e5277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:39.577089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:39.617506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190cc9a-0e99-4723-a7b9-c7f4dd7b9a76 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:39.630558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190cc9a-0e99-4723-a7b9-c7f4dd7b9a76 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:39.640696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3c529-5f60-444c-8e9f-f572250e3d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:39.641502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3c529-5f60-444c-8e9f-f572250e3d7b service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:39.641888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3c529-5f60-444c-8e9f-f572250e3d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:39.642304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3c529-5f60-444c-8e9f-f572250e3d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:39.654812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3c529-5f60-444c-8e9f-f572250e3d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:39.655968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3c529-5f60-444c-8e9f-f572250e3d7b service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:39.668899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 723/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:42.078461 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038538e4-b316-4634-ae74-8f2f870589e7 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:42.079041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038538e4-b316-4634-ae74-8f2f870589e7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:42.079041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038538e4-b316-4634-ae74-8f2f870589e7 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:42.080373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:42.085725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57df8-4d7b-46f5-b714-b461152f3c5d None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:42.086163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57df8-4d7b-46f5-b714-b461152f3c5d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:42.086294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba57df8-4d7b-46f5-b714-b461152f3c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:42.104743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-7ba57df8-4d7b-46f5-b714-b461152f3c5d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:42.106690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7ba57df8-4d7b-46f5-b714-b461152f3c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:42.114678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:42.151979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038538e4-b316-4634-ae74-8f2f870589e7 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:42.163125 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038538e4-b316-4634-ae74-8f2f870589e7 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:42.166581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1da047-f674-49e3-8b44-203fa8e89a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:42.167223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1da047-f674-49e3-8b44-203fa8e89a2b service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:42.167501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1da047-f674-49e3-8b44-203fa8e89a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:42.167772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1da047-f674-49e3-8b44-203fa8e89a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:42.178142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1da047-f674-49e3-8b44-203fa8e89a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:42.179580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1da047-f674-49e3-8b44-203fa8e89a2b service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:42.188998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 740/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:44.554982 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edd50-8a07-4569-acef-9f24a7a33881 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:44.555543 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edd50-8a07-4569-acef-9f24a7a33881 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:44.555666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edd50-8a07-4569-acef-9f24a7a33881 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:44.556983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:44.562214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b1ecb-0b04-4391-9e7a-7826b051d6f3 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:44.562663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b1ecb-0b04-4391-9e7a-7826b051d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:44.562800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b1ecb-0b04-4391-9e7a-7826b051d6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:44.581310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-378b1ecb-0b04-4391-9e7a-7826b051d6f3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:44.582542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-378b1ecb-0b04-4391-9e7a-7826b051d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:44.591439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:44.627773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287edd50-8a07-4569-acef-9f24a7a33881 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:44.638920 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287edd50-8a07-4569-acef-9f24a7a33881 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:44.642397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dc985-fee1-4315-b169-cd94fea3bd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:44.643041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dc985-fee1-4315-b169-cd94fea3bd9f service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:44.643320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dc985-fee1-4315-b169-cd94fea3bd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:44.643592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dc985-fee1-4315-b169-cd94fea3bd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:44.653730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dc985-fee1-4315-b169-cd94fea3bd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:44.655311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dc985-fee1-4315-b169-cd94fea3bd9f service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:44.664898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 726/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:48:47.022811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000766a-e4ee-4c12-9ece-18da62fcf24e None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:47.023397 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000766a-e4ee-4c12-9ece-18da62fcf24e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:47.023397 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000766a-e4ee-4c12-9ece-18da62fcf24e None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:47.024737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:48:47.030638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68410-7aed-4140-afb3-7aa5c878fd2f None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:47.031067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68410-7aed-4140-afb3-7aa5c878fd2f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:47.031197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68410-7aed-4140-afb3-7aa5c878fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:47.049459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-41d68410-7aed-4140-afb3-7aa5c878fd2f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:48:47.050692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-41d68410-7aed-4140-afb3-7aa5c878fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:48:47.058539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:48:47.099574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000766a-e4ee-4c12-9ece-18da62fcf24e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:48:47.110135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000766a-e4ee-4c12-9ece-18da62fcf24e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:48:47.113562 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082d264-25ec-43a6-9bd4-c25b273969f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:48:47.114219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082d264-25ec-43a6-9bd4-c25b273969f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:48:47.114501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082d264-25ec-43a6-9bd4-c25b273969f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:48:47.114775 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082d264-25ec-43a6-9bd4-c25b273969f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:48:47.124796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082d264-25ec-43a6-9bd4-c25b273969f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:48:47.126282 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082d264-25ec-43a6-9bd4-c25b273969f7 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:48:47.136166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 743/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:49:21.460417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00781b-d27f-4401-8ac3-da2ad7a9842a None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:21.460988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00781b-d27f-4401-8ac3-da2ad7a9842a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:21.460988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00781b-d27f-4401-8ac3-da2ad7a9842a None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:21.462263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 728/1471] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:49:21.468202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433b7e-cb24-4946-9211-8de1c9a320bc None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:21.468670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433b7e-cb24-4946-9211-8de1c9a320bc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:21.468776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81433b7e-cb24-4946-9211-8de1c9a320bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:21.487515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-81433b7e-cb24-4946-9211-8de1c9a320bc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:49:21.488680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-81433b7e-cb24-4946-9211-8de1c9a320bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:49:21.496697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 744/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:49:21.544425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965e897-6645-46f2-8351-87b19310b2ce None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:21.544715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965e897-6645-46f2-8351-87b19310b2ce None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:21.544993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965e897-6645-46f2-8351-87b19310b2ce None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:21.546367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 729/1473] 10.222.0.23 () {54 vars in 961 bytes} [Wed Apr 6 12:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:49:21.551309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb157298-e1f1-4ffa-8a7b-9ddba8401eff None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:21.551594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb157298-e1f1-4ffa-8a7b-9ddba8401eff None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:21.551868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb157298-e1f1-4ffa-8a7b-9ddba8401eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:21.570399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-cb157298-e1f1-4ffa-8a7b-9ddba8401eff None None] MFA Rules not processed for user `7330a81c0f3a496ea29ae911fcc69221`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:49:21.571571 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cb157298-e1f1-4ffa-8a7b-9ddba8401eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:49:21.577842 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 745/1474] 10.222.0.23 () {58 vars in 1058 bytes} [Wed Apr 6 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:49:21.584786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965e897-6645-46f2-8351-87b19310b2ce None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:49:21.595678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965e897-6645-46f2-8351-87b19310b2ce None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:49:21.599154 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296ac23-1a89-492b-b19c-22e906493186 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7330a81c0f3a496ea29ae911fcc69221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:49:21.599777 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296ac23-1a89-492b-b19c-22e906493186 service glance] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:21.600059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296ac23-1a89-492b-b19c-22e906493186 service glance] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:21.600330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296ac23-1a89-492b-b19c-22e906493186 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:21.609971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296ac23-1a89-492b-b19c-22e906493186 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:49:21.611460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296ac23-1a89-492b-b19c-22e906493186 service glance] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:49:21.620529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 730/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:49:24.012805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f853-37ce-44df-9cd9-bd291b9c0e65 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:24.013373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f853-37ce-44df-9cd9-bd291b9c0e65 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:24.013373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f853-37ce-44df-9cd9-bd291b9c0e65 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:24.014754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 746/1476] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:49:24.019897 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e064f1-95e0-48f8-9bd0-3d6cb2816e11 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:24.020334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e064f1-95e0-48f8-9bd0-3d6cb2816e11 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:24.020455 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e064f1-95e0-48f8-9bd0-3d6cb2816e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:24.038770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d9e064f1-95e0-48f8-9bd0-3d6cb2816e11 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:49:24.039953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d9e064f1-95e0-48f8-9bd0-3d6cb2816e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:49:24.048604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 731/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:49:24.072037 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974f853-37ce-44df-9cd9-bd291b9c0e65 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:49:24.085196 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974f853-37ce-44df-9cd9-bd291b9c0e65 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:49:24.090281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd374a4-35de-457e-a2ef-fcca2293a529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:49:24.090980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd374a4-35de-457e-a2ef-fcca2293a529 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:24.091261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd374a4-35de-457e-a2ef-fcca2293a529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:24.091541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd374a4-35de-457e-a2ef-fcca2293a529 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:24.092281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd374a4-35de-457e-a2ef-fcca2293a529 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:49:24.094076 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING py.warnings [None req-bfd374a4-35de-457e-a2ef-fcca2293a529 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:49:24.094076 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: warnings.warn(msg) Apr 06 12:49:24.094076 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: Apr 06 12:49:24.095267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd374a4-35de-457e-a2ef-fcca2293a529 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:49:24.115177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 747/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Wed Apr 6 12:49:24 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:49:26.617910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6bb30-50ef-434b-ab17-1b21d618e69b None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:26.618429 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6bb30-50ef-434b-ab17-1b21d618e69b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:26.618429 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6bb30-50ef-434b-ab17-1b21d618e69b None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:26.619759 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 732/1479] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:49:26.626691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014c3c3-2737-4284-add6-ab5688a1571f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:26.627232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014c3c3-2737-4284-add6-ab5688a1571f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:26.627336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014c3c3-2737-4284-add6-ab5688a1571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:26.645292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3014c3c3-2737-4284-add6-ab5688a1571f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:49:26.646547 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3014c3c3-2737-4284-add6-ab5688a1571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:49:26.655523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 748/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:49:26.699775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6bb30-50ef-434b-ab17-1b21d618e69b None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:49:26.714247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6bb30-50ef-434b-ab17-1b21d618e69b None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:49:26.719903 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696acb8-1206-4044-8e2a-7f4e98fefa2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:49:26.720554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696acb8-1206-4044-8e2a-7f4e98fefa2a service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:26.720832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696acb8-1206-4044-8e2a-7f4e98fefa2a service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:26.721104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696acb8-1206-4044-8e2a-7f4e98fefa2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:26.730871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696acb8-1206-4044-8e2a-7f4e98fefa2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:49:26.732165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696acb8-1206-4044-8e2a-7f4e98fefa2a service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:49:26.742025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 733/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:49:29.286327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e3cd1-3d3c-4317-8c5e-1a2c2933b998 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:29.286886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e3cd1-3d3c-4317-8c5e-1a2c2933b998 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:29.286886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e3cd1-3d3c-4317-8c5e-1a2c2933b998 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:29.288248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 749/1482] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:49:29.293935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a075e-159f-4815-af92-4f8ac4636e96 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:29.294438 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a075e-159f-4815-af92-4f8ac4636e96 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:29.294553 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a075e-159f-4815-af92-4f8ac4636e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:29.312992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f73a075e-159f-4815-af92-4f8ac4636e96 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:49:29.314217 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f73a075e-159f-4815-af92-4f8ac4636e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:49:29.321953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 734/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:49:29.358082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e3cd1-3d3c-4317-8c5e-1a2c2933b998 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:49:29.368542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e3cd1-3d3c-4317-8c5e-1a2c2933b998 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:49:29.372752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d6ead-0389-46be-a31b-ce5373b6ebf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:49:29.373392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d6ead-0389-46be-a31b-ce5373b6ebf2 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:29.373701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d6ead-0389-46be-a31b-ce5373b6ebf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:29.373977 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d6ead-0389-46be-a31b-ce5373b6ebf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:29.383344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d6ead-0389-46be-a31b-ce5373b6ebf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:49:29.384787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d6ead-0389-46be-a31b-ce5373b6ebf2 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:49:29.394557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 750/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:49:31.790823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c148a-121a-42ae-9e4a-ffacd5e69453 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:31.791397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c148a-121a-42ae-9e4a-ffacd5e69453 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:31.791397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c148a-121a-42ae-9e4a-ffacd5e69453 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:31.793334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 735/1485] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:49:31.799039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dede3-4c4a-4867-8eba-d61cc2110804 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:31.799541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dede3-4c4a-4867-8eba-d61cc2110804 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:31.799664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dede3-4c4a-4867-8eba-d61cc2110804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:31.817713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-c93dede3-4c4a-4867-8eba-d61cc2110804 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:49:31.818911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c93dede3-4c4a-4867-8eba-d61cc2110804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:49:31.826523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 751/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:49:31.863928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c148a-121a-42ae-9e4a-ffacd5e69453 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:49:31.875186 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c148a-121a-42ae-9e4a-ffacd5e69453 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:49:31.878656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fd2a5-71dd-47ee-8392-005df45e1aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:49:31.879291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fd2a5-71dd-47ee-8392-005df45e1aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:31.879571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fd2a5-71dd-47ee-8392-005df45e1aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:31.879842 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fd2a5-71dd-47ee-8392-005df45e1aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:31.888750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fd2a5-71dd-47ee-8392-005df45e1aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:49:31.890249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fd2a5-71dd-47ee-8392-005df45e1aa2 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:49:31.899347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 736/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:49:34.402511 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5fa0-826e-4b36-8f23-9300f55ff5d5 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:34.403107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5fa0-826e-4b36-8f23-9300f55ff5d5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:34.403107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5fa0-826e-4b36-8f23-9300f55ff5d5 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:34.404427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 752/1488] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:49:34.409823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0abd4-d28c-46c4-b3c4-40feb5f6863d None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:34.410290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0abd4-d28c-46c4-b3c4-40feb5f6863d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:34.410397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0abd4-d28c-46c4-b3c4-40feb5f6863d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:34.429395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-87e0abd4-d28c-46c4-b3c4-40feb5f6863d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:49:34.430908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-87e0abd4-d28c-46c4-b3c4-40feb5f6863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:49:34.438967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 737/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:49:34.479875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5fa0-826e-4b36-8f23-9300f55ff5d5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:49:34.490536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b5fa0-826e-4b36-8f23-9300f55ff5d5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:49:34.494074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb8a43-2b9a-4078-ab8a-7cd4e88f3503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:49:34.494780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8a43-2b9a-4078-ab8a-7cd4e88f3503 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:34.495063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8a43-2b9a-4078-ab8a-7cd4e88f3503 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:34.495338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb8a43-2b9a-4078-ab8a-7cd4e88f3503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:34.504765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb8a43-2b9a-4078-ab8a-7cd4e88f3503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:49:34.506292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb8a43-2b9a-4078-ab8a-7cd4e88f3503 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:49:34.516844 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 753/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:49:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:49:37.020328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b5d10-a6e9-4665-b698-5bde025aa207 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:37.020899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b5d10-a6e9-4665-b698-5bde025aa207 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:37.020899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b5d10-a6e9-4665-b698-5bde025aa207 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:37.022302 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 738/1491] 10.222.0.23 () {54 vars in 926 bytes} [Wed Apr 6 12:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:49:37.028139 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1fb96-5f1b-47fd-93be-4ee58455b999 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:37.028554 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1fb96-5f1b-47fd-93be-4ee58455b999 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:37.028697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1fb96-5f1b-47fd-93be-4ee58455b999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:37.047069 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b4d1fb96-5f1b-47fd-93be-4ee58455b999 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:49:37.048516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b4d1fb96-5f1b-47fd-93be-4ee58455b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:49:37.056359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 754/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Wed Apr 6 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:49:37.098325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b5d10-a6e9-4665-b698-5bde025aa207 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:49:37.109836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b5d10-a6e9-4665-b698-5bde025aa207 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:49:37.113319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eaadc-abcd-4f24-a1d4-05e6ecd59e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:49:37.113979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eaadc-abcd-4f24-a1d4-05e6ecd59e02 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:49:37.114261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eaadc-abcd-4f24-a1d4-05e6ecd59e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:49:37.114538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eaadc-abcd-4f24-a1d4-05e6ecd59e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:49:37.123786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eaadc-abcd-4f24-a1d4-05e6ecd59e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:49:37.125253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eaadc-abcd-4f24-a1d4-05e6ecd59e02 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:49:37.134392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 739/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:51:08.552202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b170b9e-d2f9-47c7-b9a1-3820742e6292 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:08.552797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b170b9e-d2f9-47c7-b9a1-3820742e6292 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:08.552797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b170b9e-d2f9-47c7-b9a1-3820742e6292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:08.570855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-4b170b9e-d2f9-47c7-b9a1-3820742e6292 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:51:08.572036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4b170b9e-d2f9-47c7-b9a1-3820742e6292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:51:08.579781 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 755/1494] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:51:08.588398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b06a8-0eaa-424a-970d-b9b7311aa819 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:08.588905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b06a8-0eaa-424a-970d-b9b7311aa819 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:08.589010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b06a8-0eaa-424a-970d-b9b7311aa819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:08.608488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-880b06a8-0eaa-424a-970d-b9b7311aa819 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:51:08.609711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-880b06a8-0eaa-424a-970d-b9b7311aa819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:51:08.618037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 740/1495] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:51:08.622768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b170b9e-d2f9-47c7-b9a1-3820742e6292 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:51:08.632490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b170b9e-d2f9-47c7-b9a1-3820742e6292 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:51:08.636952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877efed0-3765-41cb-9cce-da8aa51d7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:51:08.637631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877efed0-3765-41cb-9cce-da8aa51d7eec admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:08.637915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877efed0-3765-41cb-9cce-da8aa51d7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:08.638188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877efed0-3765-41cb-9cce-da8aa51d7eec admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:08.638958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877efed0-3765-41cb-9cce-da8aa51d7eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:51:08.639262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877efed0-3765-41cb-9cce-da8aa51d7eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:51:08.640273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING py.warnings [None req-877efed0-3765-41cb-9cce-da8aa51d7eec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:51:08.640273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: warnings.warn(msg) Apr 06 12:51:08.640273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: Apr 06 12:51:08.641145 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877efed0-3765-41cb-9cce-da8aa51d7eec admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:51:08.652516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 756/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:51:08.660621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b06a8-0eaa-424a-970d-b9b7311aa819 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:51:08.670460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b06a8-0eaa-424a-970d-b9b7311aa819 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:51:08.675330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dad477-3e6f-461c-b40a-fd1d9dbc8d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:51:08.675986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dad477-3e6f-461c-b40a-fd1d9dbc8d89 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:08.676267 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dad477-3e6f-461c-b40a-fd1d9dbc8d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:08.676542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dad477-3e6f-461c-b40a-fd1d9dbc8d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:08.677232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dad477-3e6f-461c-b40a-fd1d9dbc8d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:51:08.679592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING py.warnings [None req-21dad477-3e6f-461c-b40a-fd1d9dbc8d89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:51:08.679592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: warnings.warn(msg) Apr 06 12:51:08.679592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: Apr 06 12:51:08.680774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dad477-3e6f-461c-b40a-fd1d9dbc8d89 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:51:08.717406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 741/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:51:08 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:51:08.721782 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877efed0-3765-41cb-9cce-da8aa51d7eec admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:51:08.732365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877efed0-3765-41cb-9cce-da8aa51d7eec admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:51:08.787261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f0ea2-7e4d-484a-81bc-0b09112510ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:51:08.787944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f0ea2-7e4d-484a-81bc-0b09112510ef admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:08.788902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f0ea2-7e4d-484a-81bc-0b09112510ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:08.789312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f0ea2-7e4d-484a-81bc-0b09112510ef admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:08.790027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f0ea2-7e4d-484a-81bc-0b09112510ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:51:08.791065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING py.warnings [None req-a87f0ea2-7e4d-484a-81bc-0b09112510ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:51:08.791065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: warnings.warn(msg) Apr 06 12:51:08.791065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: Apr 06 12:51:08.792267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f0ea2-7e4d-484a-81bc-0b09112510ef admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:51:08.812824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 757/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:51:08 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:51:08.817009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dad477-3e6f-461c-b40a-fd1d9dbc8d89 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:51:08.827628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dad477-3e6f-461c-b40a-fd1d9dbc8d89 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:51:08.832250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc47d4-3cc8-4c2f-a6d7-c4d33d82de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:51:08.832857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc47d4-3cc8-4c2f-a6d7-c4d33d82de5a admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:08.833154 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc47d4-3cc8-4c2f-a6d7-c4d33d82de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:08.833420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc47d4-3cc8-4c2f-a6d7-c4d33d82de5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:08.834221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc47d4-3cc8-4c2f-a6d7-c4d33d82de5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:51:08.835861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING py.warnings [None req-7ccc47d4-3cc8-4c2f-a6d7-c4d33d82de5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:51:08.835861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: warnings.warn(msg) Apr 06 12:51:08.835861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: Apr 06 12:51:08.836746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc47d4-3cc8-4c2f-a6d7-c4d33d82de5a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:51:08.850165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 742/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:51:08.854986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f0ea2-7e4d-484a-81bc-0b09112510ef admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:51:08.864907 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f0ea2-7e4d-484a-81bc-0b09112510ef admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:51:08.869511 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85048a9b-5048-4103-863f-2d897ed1dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:51:08.870205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048a9b-5048-4103-863f-2d897ed1dcaf admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:08.870486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048a9b-5048-4103-863f-2d897ed1dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:08.870761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048a9b-5048-4103-863f-2d897ed1dcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:08.871487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85048a9b-5048-4103-863f-2d897ed1dcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:51:08.872499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING py.warnings [None req-85048a9b-5048-4103-863f-2d897ed1dcaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:51:08.872499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: warnings.warn(msg) Apr 06 12:51:08.872499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: Apr 06 12:51:08.873373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85048a9b-5048-4103-863f-2d897ed1dcaf admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:51:08.886591 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 758/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:51:08.890692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc47d4-3cc8-4c2f-a6d7-c4d33d82de5a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:51:08.901085 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc47d4-3cc8-4c2f-a6d7-c4d33d82de5a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:51:08.905587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c913-0a6d-4873-b790-57a87a527f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:51:08.906473 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c913-0a6d-4873-b790-57a87a527f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:08.906756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c913-0a6d-4873-b790-57a87a527f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:08.907032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3c913-0a6d-4873-b790-57a87a527f80 admin admin] PATH_INFO: `/v3/projects/1eb315623297491782687474dd422244/users/c54f8f5d37d74321af73cd392879278b/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:08.922203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c913-0a6d-4873-b790-57a87a527f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb315623297491782687474dd422244, user_id=c54f8f5d37d74321af73cd392879278b, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:51:08.923274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING py.warnings [None req-55f3c913-0a6d-4873-b790-57a87a527f80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:51:08.923274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: warnings.warn(msg) Apr 06 12:51:08.923274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: Apr 06 12:51:08.925201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3c913-0a6d-4873-b790-57a87a527f80 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:51:08.937835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 743/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:51:08 2022] PUT /identity/v3/projects/1eb315623297491782687474dd422244/users/c54f8f5d37d74321af73cd392879278b/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:51:08.949360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41eea-f337-4802-bcb8-9ffe3e98610c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:08.949754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41eea-f337-4802-bcb8-9ffe3e98610c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:08.950041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a41eea-f337-4802-bcb8-9ffe3e98610c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:08.975605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-70a41eea-f337-4802-bcb8-9ffe3e98610c None None] MFA Rules not processed for user `c54f8f5d37d74321af73cd392879278b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:51:08.977487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-70a41eea-f337-4802-bcb8-9ffe3e98610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:51:09.038129 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 759/1502] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:51:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:51:09.049941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c913-0a6d-4873-b790-57a87a527f80 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:51:09.118593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3c913-0a6d-4873-b790-57a87a527f80 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:51:09.123916 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3090874-0c74-4c8b-99ce-5578eab2a762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:51:09.124563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3090874-0c74-4c8b-99ce-5578eab2a762 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:09.124845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3090874-0c74-4c8b-99ce-5578eab2a762 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:09.125119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3090874-0c74-4c8b-99ce-5578eab2a762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:09.133358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3090874-0c74-4c8b-99ce-5578eab2a762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:51:09.135011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3090874-0c74-4c8b-99ce-5578eab2a762 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:51:09.143499 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 744/1503] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:51:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:51:09.215573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b10274-05ec-468c-a067-954381183e43 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:09.215877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b10274-05ec-468c-a067-954381183e43 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:09.216151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b10274-05ec-468c-a067-954381183e43 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:09.217427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 760/1504] 10.222.0.23 () {52 vars in 829 bytes} [Wed Apr 6 12:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:51:09.221023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3090874-0c74-4c8b-99ce-5578eab2a762 service nova] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:51:09.280398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3090874-0c74-4c8b-99ce-5578eab2a762 service nova] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:51:09.284895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:51:09.285784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:09.286063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:09.286333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] PATH_INFO: `/v3/users/c54f8f5d37d74321af73cd392879278b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:09.287519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c54f8f5d37d74321af73cd392879278b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:51:09.288572 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING py.warnings [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:51:09.288572 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: warnings.warn(msg) Apr 06 12:51:09.288572 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: Apr 06 12:51:09.289806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:51:09.355798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c54f8f5d37d74321af73cd392879278b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:51:09.356553 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c54f8f5d37d74321af73cd392879278b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:51:09.357153 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c54f8f5d37d74321af73cd392879278b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:51:09.372169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c54f8f5d37d74321af73cd392879278b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:51:09.390338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c54f8f5d37d74321af73cd392879278b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:51:09.406943 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 745/1505] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:51:09 2022] DELETE /identity/v3/users/c54f8f5d37d74321af73cd392879278b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:51:09.411589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bf22c-9321-4e10-9315-6e3bc767e00e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:09.411882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bf22c-9321-4e10-9315-6e3bc767e00e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:09.412186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bf22c-9321-4e10-9315-6e3bc767e00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:09.430279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-121bf22c-9321-4e10-9315-6e3bc767e00e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:51:09.431465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-121bf22c-9321-4e10-9315-6e3bc767e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:51:09.486721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 761/1506] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:51:09.497021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:51:09.498464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:51:09.558061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a14b21-2aa4-499c-b14c-28de05a07e4d admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:51:09.561917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8eda4-bd3d-4ac4-9cc7-00d97483aba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:51:09.562590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8eda4-bd3d-4ac4-9cc7-00d97483aba1 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:09.562876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8eda4-bd3d-4ac4-9cc7-00d97483aba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:09.563151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8eda4-bd3d-4ac4-9cc7-00d97483aba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:09.573692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8eda4-bd3d-4ac4-9cc7-00d97483aba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:51:09.575194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8eda4-bd3d-4ac4-9cc7-00d97483aba1 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:51:09.585726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 746/1507] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:51:09.953224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bf22c-9321-4e10-9315-6e3bc767e00e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:51:09.954755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-121bf22c-9321-4e10-9315-6e3bc767e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:51:09.967071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bf22c-9321-4e10-9315-6e3bc767e00e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:51:09.977074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:51:09.978067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:51:09.978352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:51:09.978638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] PATH_INFO: `/v3/projects/1eb315623297491782687474dd422244` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:51:09.979839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb315623297491782687474dd422244)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:51:09.980869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING py.warnings [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:51:09.980869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: warnings.warn(msg) Apr 06 12:51:09.980869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: Apr 06 12:51:09.982092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:51:10.043161 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb315623297491782687474dd422244', 'request_id': 'req-34f0f610-5e18-48ea-b14a-9427bc0b8437'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:51:10.057140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb315623297491782687474dd422244', 'request_id': 'req-34f0f610-5e18-48ea-b14a-9427bc0b8437'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:51:10.067426 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb315623297491782687474dd422244', 'request_id': 'req-34f0f610-5e18-48ea-b14a-9427bc0b8437'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:51:10.079005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] The token cache is being invalidate because project 1eb315623297491782687474dd422244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:51:10.079300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:51:10.080035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34f0f610-5e18-48ea-b14a-9427bc0b8437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:51:10.081611 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 762/1508] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:51:09 2022] DELETE /identity/v3/projects/1eb315623297491782687474dd422244 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:52:53.266813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b3efd-7fdd-447f-a314-344d6034104f None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:53.267436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b3efd-7fdd-447f-a314-344d6034104f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:53.267436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b3efd-7fdd-447f-a314-344d6034104f None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:53.269051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 747/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:52:53.274765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5598-8de4-4e84-bb48-bc96c96442ae None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:53.275288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5598-8de4-4e84-bb48-bc96c96442ae None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:53.275410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5598-8de4-4e84-bb48-bc96c96442ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:53.293494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5d7b5598-8de4-4e84-bb48-bc96c96442ae None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:52:53.294717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5d7b5598-8de4-4e84-bb48-bc96c96442ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:52:53.353126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 763/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:52:53.506836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b3efd-7fdd-447f-a314-344d6034104f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:52:53.508804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-863b3efd-7fdd-447f-a314-344d6034104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:52:53.583614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b3efd-7fdd-447f-a314-344d6034104f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:52:53.588926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee570f-670a-4d5f-88df-30fc25680846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:52:53.589591 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee570f-670a-4d5f-88df-30fc25680846 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:53.589886 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee570f-670a-4d5f-88df-30fc25680846 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:53.590165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee570f-670a-4d5f-88df-30fc25680846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:53.599483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee570f-670a-4d5f-88df-30fc25680846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:52:53.601165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee570f-670a-4d5f-88df-30fc25680846 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:52:53.610964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 748/1511] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:52:53.909100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8f57-8f32-4ae0-b730-d1f9a73d8057 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:53.911373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8f57-8f32-4ae0-b730-d1f9a73d8057 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:53.911682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c8f57-8f32-4ae0-b730-d1f9a73d8057 None None] PATH_INFO: `/v3` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:53.913023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 764/1512] 10.222.0.11 () {54 vars in 925 bytes} [Wed Apr 6 12:52:53 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:52:53.919889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758795-1213-41b0-ad59-2bf62a80dade None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:53.920182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758795-1213-41b0-ad59-2bf62a80dade None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:53.920464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758795-1213-41b0-ad59-2bf62a80dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:53.938602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-5e758795-1213-41b0-ad59-2bf62a80dade None None] MFA Rules not processed for user `221dab3ebc4f4c68b253729391e9c503`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:52:53.939805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-5e758795-1213-41b0-ad59-2bf62a80dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:52:54.000767 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 749/1513] 10.222.0.11 () {58 vars in 1015 bytes} [Wed Apr 6 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:52:54.949647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738f380-690b-4f80-be2d-40f9d20ea421 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:54.950239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738f380-690b-4f80-be2d-40f9d20ea421 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:54.950239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738f380-690b-4f80-be2d-40f9d20ea421 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:54.951572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:52:54.957367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21377bd-2494-437f-b3a8-5fe17dd25bda None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:54.957838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21377bd-2494-437f-b3a8-5fe17dd25bda None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:54.957957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21377bd-2494-437f-b3a8-5fe17dd25bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:54.976120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f21377bd-2494-437f-b3a8-5fe17dd25bda None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:52:54.977302 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f21377bd-2494-437f-b3a8-5fe17dd25bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:52:54.985001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:52:55.138007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738f380-690b-4f80-be2d-40f9d20ea421 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:52:55.152789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738f380-690b-4f80-be2d-40f9d20ea421 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:52:55.158275 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecb00a-823c-4ec2-8abf-bc1352986e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:52:55.158927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb00a-823c-4ec2-8abf-bc1352986e1b service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:55.159339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb00a-823c-4ec2-8abf-bc1352986e1b service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:55.160158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb00a-823c-4ec2-8abf-bc1352986e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:55.168706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecb00a-823c-4ec2-8abf-bc1352986e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:52:55.170342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecb00a-823c-4ec2-8abf-bc1352986e1b service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:52:55.181028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 766/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:52:57.976236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a85b9-6f12-45dc-a33b-0a7a48aef091 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:57.976889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a85b9-6f12-45dc-a33b-0a7a48aef091 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:57.976889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a85b9-6f12-45dc-a33b-0a7a48aef091 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:57.978188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 751/1517] 10.222.0.23 () {54 vars in 960 bytes} [Wed Apr 6 12:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:52:57.983087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d509fe7-d46f-4455-ac05-02ed63353293 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:57.983555 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d509fe7-d46f-4455-ac05-02ed63353293 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:57.983661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d509fe7-d46f-4455-ac05-02ed63353293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:58.002657 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-0d509fe7-d46f-4455-ac05-02ed63353293 None None] MFA Rules not processed for user `221dab3ebc4f4c68b253729391e9c503`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:52:58.004457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0d509fe7-d46f-4455-ac05-02ed63353293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:52:58.013010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 767/1518] 10.222.0.23 () {58 vars in 1057 bytes} [Wed Apr 6 12:52:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:52:58.021238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a85b9-6f12-45dc-a33b-0a7a48aef091 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:52:58.035289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a85b9-6f12-45dc-a33b-0a7a48aef091 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:52:58.040261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4027a83-ce08-463d-9ea5-809d0055b617 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221dab3ebc4f4c68b253729391e9c503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:52:58.040901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4027a83-ce08-463d-9ea5-809d0055b617 service placement] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:52:58.041183 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4027a83-ce08-463d-9ea5-809d0055b617 service placement] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:52:58.041458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4027a83-ce08-463d-9ea5-809d0055b617 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:52:58.050029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4027a83-ce08-463d-9ea5-809d0055b617 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:52:58.051645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4027a83-ce08-463d-9ea5-809d0055b617 service placement] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:52:58.061163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 752/1519] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:53:06.950894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a66df7-caf4-49a6-b1ae-40caffedbd93 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:06.951501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a66df7-caf4-49a6-b1ae-40caffedbd93 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:06.951501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a66df7-caf4-49a6-b1ae-40caffedbd93 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:06.952800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 768/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:53:06.958603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18ada0-31fd-425a-bbfc-57c5e6da6fdc None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:06.959106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18ada0-31fd-425a-bbfc-57c5e6da6fdc None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:06.959225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18ada0-31fd-425a-bbfc-57c5e6da6fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:06.977954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-1b18ada0-31fd-425a-bbfc-57c5e6da6fdc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:53:06.979155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1b18ada0-31fd-425a-bbfc-57c5e6da6fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:53:06.987549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 753/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:53:07.142378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a66df7-caf4-49a6-b1ae-40caffedbd93 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:53:07.157355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a66df7-caf4-49a6-b1ae-40caffedbd93 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:53:07.164082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964fb84-d9af-49ee-a84f-2f0ce4fecb10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:53:07.164741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964fb84-d9af-49ee-a84f-2f0ce4fecb10 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:07.165019 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964fb84-d9af-49ee-a84f-2f0ce4fecb10 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:07.165314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964fb84-d9af-49ee-a84f-2f0ce4fecb10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:07.174949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964fb84-d9af-49ee-a84f-2f0ce4fecb10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:53:07.176705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964fb84-d9af-49ee-a84f-2f0ce4fecb10 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:53:07.186283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 769/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:53:08.470318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae49d2-8b2a-4e26-b34c-78e0b0fd5b10 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:08.470873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae49d2-8b2a-4e26-b34c-78e0b0fd5b10 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:08.470873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae49d2-8b2a-4e26-b34c-78e0b0fd5b10 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:08.472961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 754/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed Apr 6 12:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:53:08.478874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33b5d-d959-464f-982c-ecd3166448d1 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:08.479426 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33b5d-d959-464f-982c-ecd3166448d1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:08.479531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a33b5d-d959-464f-982c-ecd3166448d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:08.498853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-81a33b5d-d959-464f-982c-ecd3166448d1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:53:08.500152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-81a33b5d-d959-464f-982c-ecd3166448d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:53:08.508573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 770/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed Apr 6 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:53:08.681423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae49d2-8b2a-4e26-b34c-78e0b0fd5b10 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:53:08.696180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae49d2-8b2a-4e26-b34c-78e0b0fd5b10 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:53:08.701495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce4c2b-6a3e-46e9-97b7-ad914a188cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:53:08.702164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4c2b-6a3e-46e9-97b7-ad914a188cd9 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:08.702446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4c2b-6a3e-46e9-97b7-ad914a188cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:08.702722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4c2b-6a3e-46e9-97b7-ad914a188cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:08.710984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce4c2b-6a3e-46e9-97b7-ad914a188cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:53:08.712604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce4c2b-6a3e-46e9-97b7-ad914a188cd9 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:53:08.725666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 755/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:53:13.060642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507b52f-e1b5-4268-979b-e62482d6ab78 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:13.061215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507b52f-e1b5-4268-979b-e62482d6ab78 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:13.061324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507b52f-e1b5-4268-979b-e62482d6ab78 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:13.062888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 771/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:53:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:53:13.068155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d794162-653c-4830-acf6-c8ea2ccd78dd None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:13.068614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d794162-653c-4830-acf6-c8ea2ccd78dd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:13.068710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d794162-653c-4830-acf6-c8ea2ccd78dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:13.086377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-0d794162-653c-4830-acf6-c8ea2ccd78dd None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:53:13.087568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0d794162-653c-4830-acf6-c8ea2ccd78dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:53:13.095313 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 756/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:53:13.132679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507b52f-e1b5-4268-979b-e62482d6ab78 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:53:13.134342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e507b52f-e1b5-4268-979b-e62482d6ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:53:13.191853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507b52f-e1b5-4268-979b-e62482d6ab78 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:53:13.195398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a77c9-db5b-42d5-b762-d3c900930e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:53:13.196040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a77c9-db5b-42d5-b762-d3c900930e9f service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:13.196325 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a77c9-db5b-42d5-b762-d3c900930e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:13.196603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a77c9-db5b-42d5-b762-d3c900930e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:13.206434 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a77c9-db5b-42d5-b762-d3c900930e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:53:13.207958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a77c9-db5b-42d5-b762-d3c900930e9f service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:53:13.217225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 772/1528] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:53:15.580772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9aff1-2341-4f5d-a645-87eb879d0031 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:15.581368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9aff1-2341-4f5d-a645-87eb879d0031 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:15.581721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9aff1-2341-4f5d-a645-87eb879d0031 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:15.583232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 757/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:53:15.588520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d0b2d-98b6-4535-84f4-cb52e326fc09 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:15.588974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d0b2d-98b6-4535-84f4-cb52e326fc09 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:15.589082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d0b2d-98b6-4535-84f4-cb52e326fc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:15.607960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-118d0b2d-98b6-4535-84f4-cb52e326fc09 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:53:15.609150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-118d0b2d-98b6-4535-84f4-cb52e326fc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:53:15.617141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 773/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:53:15.653964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9aff1-2341-4f5d-a645-87eb879d0031 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:53:15.655657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-89e9aff1-2341-4f5d-a645-87eb879d0031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:53:15.668866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9aff1-2341-4f5d-a645-87eb879d0031 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:53:15.672577 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab297059-96d5-4a5c-a5e0-e28d00a53da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:53:15.673213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab297059-96d5-4a5c-a5e0-e28d00a53da5 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:15.673495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab297059-96d5-4a5c-a5e0-e28d00a53da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:15.673795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab297059-96d5-4a5c-a5e0-e28d00a53da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:15.683124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab297059-96d5-4a5c-a5e0-e28d00a53da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:53:15.684583 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab297059-96d5-4a5c-a5e0-e28d00a53da5 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:53:15.694091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 758/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:53:19.544871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97b5e2-6c91-4fa2-9a8c-b03f02980678 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:19.545436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97b5e2-6c91-4fa2-9a8c-b03f02980678 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:19.545436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97b5e2-6c91-4fa2-9a8c-b03f02980678 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:19.547070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 774/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:53:19.552744 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467d00e-5d95-4c75-9c13-60466170c0da None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:19.553258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467d00e-5d95-4c75-9c13-60466170c0da None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:19.553368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467d00e-5d95-4c75-9c13-60466170c0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:19.571287 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c467d00e-5d95-4c75-9c13-60466170c0da None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:53:19.572493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c467d00e-5d95-4c75-9c13-60466170c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:53:19.580914 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 759/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:53:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:53:19.852413 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97b5e2-6c91-4fa2-9a8c-b03f02980678 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:53:19.854198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7a97b5e2-6c91-4fa2-9a8c-b03f02980678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:53:19.910996 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97b5e2-6c91-4fa2-9a8c-b03f02980678 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:53:19.914518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0462cd-26d3-495d-a483-e2d038354351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:53:19.915166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0462cd-26d3-495d-a483-e2d038354351 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:19.915449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0462cd-26d3-495d-a483-e2d038354351 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:19.915725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0462cd-26d3-495d-a483-e2d038354351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:19.925526 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0462cd-26d3-495d-a483-e2d038354351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:53:19.926996 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0462cd-26d3-495d-a483-e2d038354351 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:53:19.936160 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 775/1534] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:53:22.391912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d82e77-8283-4ce8-8b91-892fc3871e17 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:22.392983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d82e77-8283-4ce8-8b91-892fc3871e17 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:22.393083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d82e77-8283-4ce8-8b91-892fc3871e17 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:22.395055 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 760/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed Apr 6 12:53:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:53:22.400608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa484-bc3e-4fcc-ba2b-f5c3d430a1c0 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:22.401103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa484-bc3e-4fcc-ba2b-f5c3d430a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:22.401199 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caa484-bc3e-4fcc-ba2b-f5c3d430a1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:22.419885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-30caa484-bc3e-4fcc-ba2b-f5c3d430a1c0 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:53:22.421339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-30caa484-bc3e-4fcc-ba2b-f5c3d430a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:53:22.429448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 776/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Apr 6 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:53:22.709066 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e555ec1-8959-4d1a-9781-5535f00b091e None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:22.709345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e555ec1-8959-4d1a-9781-5535f00b091e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:22.709661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e555ec1-8959-4d1a-9781-5535f00b091e None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:22.711029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 761/1537] 10.222.0.23 () {54 vars in 962 bytes} [Wed Apr 6 12:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:53:22.716103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffce6e5-4a7a-4ce7-ad3c-52404d58132e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:22.716390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffce6e5-4a7a-4ce7-ad3c-52404d58132e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:22.716666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffce6e5-4a7a-4ce7-ad3c-52404d58132e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:22.735218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-bffce6e5-4a7a-4ce7-ad3c-52404d58132e None None] MFA Rules not processed for user `7277fd0f4cf64df4aaa65d7743b99028`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:53:22.736506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bffce6e5-4a7a-4ce7-ad3c-52404d58132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:53:22.743629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 777/1538] 10.222.0.23 () {58 vars in 1059 bytes} [Wed Apr 6 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:53:22.752618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e555ec1-8959-4d1a-9781-5535f00b091e None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:53:22.763117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e555ec1-8959-4d1a-9781-5535f00b091e None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:53:22.766604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a64ed-10d5-4d0b-95ba-593ec3c54c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:53:22.767235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a64ed-10d5-4d0b-95ba-593ec3c54c2d service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:53:22.768103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a64ed-10d5-4d0b-95ba-593ec3c54c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:53:22.768380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a64ed-10d5-4d0b-95ba-593ec3c54c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:53:22.777822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a64ed-10d5-4d0b-95ba-593ec3c54c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:53:22.779292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a64ed-10d5-4d0b-95ba-593ec3c54c2d service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:53:22.788982 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 762/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:54:53.912126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa0b7-9362-411f-8765-56d4d05cc8c3 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:53.912756 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa0b7-9362-411f-8765-56d4d05cc8c3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:53.912756 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aa0b7-9362-411f-8765-56d4d05cc8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:53.951929 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-a12aa0b7-9362-411f-8765-56d4d05cc8c3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:53.953336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a12aa0b7-9362-411f-8765-56d4d05cc8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:53.966410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 778/1540] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:54:53.977538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cb161-032a-4ca7-84fe-35362c40bf21 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:53.978596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cb161-032a-4ca7-84fe-35362c40bf21 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:53.979084 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3cb161-032a-4ca7-84fe-35362c40bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.007736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3d3cb161-032a-4ca7-84fe-35362c40bf21 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.009330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3d3cb161-032a-4ca7-84fe-35362c40bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.029551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 763/1541] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:54:54.035473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa0b7-9362-411f-8765-56d4d05cc8c3 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.054503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aa0b7-9362-411f-8765-56d4d05cc8c3 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.066403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c13f-1265-4afa-8718-a400f30f248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.067131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c13f-1265-4afa-8718-a400f30f248f admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.067424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c13f-1265-4afa-8718-a400f30f248f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.067709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c13f-1265-4afa-8718-a400f30f248f admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.068677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754c13f-1265-4afa-8718-a400f30f248f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:54:54.068993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754c13f-1265-4afa-8718-a400f30f248f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.070871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754c13f-1265-4afa-8718-a400f30f248f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.086386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 779/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:54:54.095464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cb161-032a-4ca7-84fe-35362c40bf21 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.105716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3cb161-032a-4ca7-84fe-35362c40bf21 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.118460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0d3c8-9e73-444b-9928-4100caa90c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.119160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0d3c8-9e73-444b-9928-4100caa90c3d admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.119440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0d3c8-9e73-444b-9928-4100caa90c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.119708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0d3c8-9e73-444b-9928-4100caa90c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.120433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0d3c8-9e73-444b-9928-4100caa90c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.122498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0d3c8-9e73-444b-9928-4100caa90c3d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.171269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 764/1543] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:54.176434 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c13f-1265-4afa-8718-a400f30f248f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.200624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c13f-1265-4afa-8718-a400f30f248f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.296975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca259-e1ed-4728-9527-6a5046eea469 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.297357 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca259-e1ed-4728-9527-6a5046eea469 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.297534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca259-e1ed-4728-9527-6a5046eea469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.303626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1837e3-92cb-4df5-b406-60e5e81762d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.304758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1837e3-92cb-4df5-b406-60e5e81762d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.305279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1837e3-92cb-4df5-b406-60e5e81762d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.305813 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1837e3-92cb-4df5-b406-60e5e81762d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.306796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1837e3-92cb-4df5-b406-60e5e81762d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.309090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1837e3-92cb-4df5-b406-60e5e81762d5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.363019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-9e4ca259-e1ed-4728-9527-6a5046eea469 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.367556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9e4ca259-e1ed-4728-9527-6a5046eea469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.385819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 765/1544] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:54:54.386717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 780/1545] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:54.387129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaafe33-3b45-45ff-ae8d-010d18ae6d31 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.387420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaafe33-3b45-45ff-ae8d-010d18ae6d31 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.387881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaafe33-3b45-45ff-ae8d-010d18ae6d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.391005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b03350-1974-4bad-b130-63dce63077ee None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.391296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b03350-1974-4bad-b130-63dce63077ee None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.391578 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b03350-1974-4bad-b130-63dce63077ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.429188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-eaaafe33-3b45-45ff-ae8d-010d18ae6d31 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.430875 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-eaaafe33-3b45-45ff-ae8d-010d18ae6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.433024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-45b03350-1974-4bad-b130-63dce63077ee None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.435933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-45b03350-1974-4bad-b130-63dce63077ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.454131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 766/1546] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.456093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaafe33-3b45-45ff-ae8d-010d18ae6d31 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.463563 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 781/1547] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.469614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b6a3e-3694-4104-979b-6ff3b1883ca7 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.469614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b6a3e-3694-4104-979b-6ff3b1883ca7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.469614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b6a3e-3694-4104-979b-6ff3b1883ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.475407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaafe33-3b45-45ff-ae8d-010d18ae6d31 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.481292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5937f94-c166-4828-a3dd-761bb92b7de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.482220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937f94-c166-4828-a3dd-761bb92b7de5 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.482451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937f94-c166-4828-a3dd-761bb92b7de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.482642 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5937f94-c166-4828-a3dd-761bb92b7de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.483415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5937f94-c166-4828-a3dd-761bb92b7de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.485071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5937f94-c166-4828-a3dd-761bb92b7de5 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.496860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-ca9b6a3e-3694-4104-979b-6ff3b1883ca7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.498696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-ca9b6a3e-3694-4104-979b-6ff3b1883ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.501799 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 767/1548] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:54.503199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b025-df1c-4bc5-8490-2354a0c693af None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.503567 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b025-df1c-4bc5-8490-2354a0c693af None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.503977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62b025-df1c-4bc5-8490-2354a0c693af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.515567 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 782/1549] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.520540 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ed5a8-ad23-4690-9a2e-0d957250dbe9 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.521228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ed5a8-ad23-4690-9a2e-0d957250dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.521518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ed5a8-ad23-4690-9a2e-0d957250dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.523943 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-ca62b025-df1c-4bc5-8490-2354a0c693af None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.525651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ca62b025-df1c-4bc5-8490-2354a0c693af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.533918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 768/1550] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.535294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcd3b9-035e-4b29-a14f-4419a25840a8 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.535585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcd3b9-035e-4b29-a14f-4419a25840a8 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.535866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcd3b9-035e-4b29-a14f-4419a25840a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.546772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-091ed5a8-ad23-4690-9a2e-0d957250dbe9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.548261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-091ed5a8-ad23-4690-9a2e-0d957250dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.553743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-2ebcd3b9-035e-4b29-a14f-4419a25840a8 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.554959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2ebcd3b9-035e-4b29-a14f-4419a25840a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.557178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 783/1551] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.558528 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075408ee-9d29-4e5b-a5b9-06d2a77b833f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.558830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075408ee-9d29-4e5b-a5b9-06d2a77b833f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.559085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075408ee-9d29-4e5b-a5b9-06d2a77b833f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.564163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 769/1552] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.565335 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2c34-a3fd-43be-bc92-0b09ad86afda None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.565658 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2c34-a3fd-43be-bc92-0b09ad86afda None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.565945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2c34-a3fd-43be-bc92-0b09ad86afda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.580845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-075408ee-9d29-4e5b-a5b9-06d2a77b833f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.582079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-075408ee-9d29-4e5b-a5b9-06d2a77b833f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.584289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-7b0c2c34-a3fd-43be-bc92-0b09ad86afda None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.585447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7b0c2c34-a3fd-43be-bc92-0b09ad86afda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.589975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 784/1553] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.590604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075408ee-9d29-4e5b-a5b9-06d2a77b833f None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.596002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 770/1554] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.596663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c2c34-a3fd-43be-bc92-0b09ad86afda None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.600642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075408ee-9d29-4e5b-a5b9-06d2a77b833f None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.605168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c270e3d-82f9-4eb0-9ff1-f1616625f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.605866 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270e3d-82f9-4eb0-9ff1-f1616625f93b admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.606149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270e3d-82f9-4eb0-9ff1-f1616625f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.606343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c2c34-a3fd-43be-bc92-0b09ad86afda None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.606452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c270e3d-82f9-4eb0-9ff1-f1616625f93b admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.607205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c270e3d-82f9-4eb0-9ff1-f1616625f93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.609072 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c270e3d-82f9-4eb0-9ff1-f1616625f93b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.610895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f24368-f7c1-48d7-bb67-3fd9d5945051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.611539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24368-f7c1-48d7-bb67-3fd9d5945051 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.611813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24368-f7c1-48d7-bb67-3fd9d5945051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.612083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24368-f7c1-48d7-bb67-3fd9d5945051 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.612801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f24368-f7c1-48d7-bb67-3fd9d5945051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:54:54.613106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f24368-f7c1-48d7-bb67-3fd9d5945051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.614163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING py.warnings [None req-27f24368-f7c1-48d7-bb67-3fd9d5945051 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:54:54.614163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: warnings.warn(msg) Apr 06 12:54:54.614163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: Apr 06 12:54:54.615047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f24368-f7c1-48d7-bb67-3fd9d5945051 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.619247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 785/1555] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:54.621248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63391fa-8d8c-4c5f-88d4-c7ef0868d227 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.621534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63391fa-8d8c-4c5f-88d4-c7ef0868d227 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.621838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63391fa-8d8c-4c5f-88d4-c7ef0868d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.633258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 771/1556] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:54:54.635214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20488fb4-d840-472f-bf7c-c44c3342c6b3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.635701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20488fb4-d840-472f-bf7c-c44c3342c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.636172 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20488fb4-d840-472f-bf7c-c44c3342c6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.648518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d63391fa-8d8c-4c5f-88d4-c7ef0868d227 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.649793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d63391fa-8d8c-4c5f-88d4-c7ef0868d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.658027 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-20488fb4-d840-472f-bf7c-c44c3342c6b3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.659210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-20488fb4-d840-472f-bf7c-c44c3342c6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.661614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 786/1557] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.661614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94289283-37e8-440f-a1df-cbb9fb7d7260 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.661614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94289283-37e8-440f-a1df-cbb9fb7d7260 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.661976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94289283-37e8-440f-a1df-cbb9fb7d7260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.674048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 772/1558] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.675958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb506-93ac-4e77-b8f4-821b79369c76 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.676250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb506-93ac-4e77-b8f4-821b79369c76 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.676528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb506-93ac-4e77-b8f4-821b79369c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.686098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-94289283-37e8-440f-a1df-cbb9fb7d7260 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.687255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-94289283-37e8-440f-a1df-cbb9fb7d7260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.695741 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-eeabb506-93ac-4e77-b8f4-821b79369c76 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.696475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 787/1559] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.697323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94289283-37e8-440f-a1df-cbb9fb7d7260 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.700650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-eeabb506-93ac-4e77-b8f4-821b79369c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.707250 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94289283-37e8-440f-a1df-cbb9fb7d7260 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.709650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 773/1560] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.713533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabb506-93ac-4e77-b8f4-821b79369c76 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.713689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8b4ac-0137-4eba-bce1-279d9f636b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.713689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8b4ac-0137-4eba-bce1-279d9f636b56 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.713689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8b4ac-0137-4eba-bce1-279d9f636b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.713689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8b4ac-0137-4eba-bce1-279d9f636b56 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.714008 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8b4ac-0137-4eba-bce1-279d9f636b56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:54:54.714090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8b4ac-0137-4eba-bce1-279d9f636b56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.715647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8b4ac-0137-4eba-bce1-279d9f636b56 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.720513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabb506-93ac-4e77-b8f4-821b79369c76 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.725084 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382437-c05e-4fdd-b717-3729d4a01d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.725784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382437-c05e-4fdd-b717-3729d4a01d76 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.726067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382437-c05e-4fdd-b717-3729d4a01d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.726345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d382437-c05e-4fdd-b717-3729d4a01d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.727067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382437-c05e-4fdd-b717-3729d4a01d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:54:54.727373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382437-c05e-4fdd-b717-3729d4a01d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.727608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 788/1561] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:54:54.728382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8b4ac-0137-4eba-bce1-279d9f636b56 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.729016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d382437-c05e-4fdd-b717-3729d4a01d76 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.738111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8b4ac-0137-4eba-bce1-279d9f636b56 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.741192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 774/1562] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:54:54.742233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382437-c05e-4fdd-b717-3729d4a01d76 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.746963 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf6f3f-dabe-4f67-9551-4d29b527b172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.748451 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6f3f-dabe-4f67-9551-4d29b527b172 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.749014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6f3f-dabe-4f67-9551-4d29b527b172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.749298 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6f3f-dabe-4f67-9551-4d29b527b172 admin admin] PATH_INFO: `/v3/projects/d182b02f06234cd1b7be27af5000f785/users/d1ba82d333a54abaa2d025c0f6dffce7/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.754015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d382437-c05e-4fdd-b717-3729d4a01d76 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.758690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9b616-0d64-4969-8676-ac97364861c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.759335 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9b616-0d64-4969-8676-ac97364861c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.759611 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9b616-0d64-4969-8676-ac97364861c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.759882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9b616-0d64-4969-8676-ac97364861c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.760555 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9b616-0d64-4969-8676-ac97364861c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.762505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9b616-0d64-4969-8676-ac97364861c9 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.764508 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf6f3f-dabe-4f67-9551-4d29b527b172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d182b02f06234cd1b7be27af5000f785, user_id=d1ba82d333a54abaa2d025c0f6dffce7, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.765703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING py.warnings [None req-91cf6f3f-dabe-4f67-9551-4d29b527b172 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:54:54.765703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: warnings.warn(msg) Apr 06 12:54:54.765703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: Apr 06 12:54:54.767624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf6f3f-dabe-4f67-9551-4d29b527b172 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.781204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 789/1563] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:54:54 2022] PUT /identity/v3/projects/d182b02f06234cd1b7be27af5000f785/users/d1ba82d333a54abaa2d025c0f6dffce7/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:54.782553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6cb6f-0cbb-41a9-845a-9251bc706fc9 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.782812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6cb6f-0cbb-41a9-845a-9251bc706fc9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.783083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6cb6f-0cbb-41a9-845a-9251bc706fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.796271 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 775/1564] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:54.797686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9b616-0d64-4969-8676-ac97364861c9 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.801231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5da6cb6f-0cbb-41a9-845a-9251bc706fc9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.802472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5da6cb6f-0cbb-41a9-845a-9251bc706fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:54.864102 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 790/1565] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:54.865272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6cb6f-0cbb-41a9-845a-9251bc706fc9 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.867131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9b616-0d64-4969-8676-ac97364861c9 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.871944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed4eed-2c91-4242-87be-7023b2118e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.872641 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4eed-2c91-4242-87be-7023b2118e80 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.872946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4eed-2c91-4242-87be-7023b2118e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.873914 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4eed-2c91-4242-87be-7023b2118e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.874688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed4eed-2c91-4242-87be-7023b2118e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:54:54.875002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed4eed-2c91-4242-87be-7023b2118e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.876676 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed4eed-2c91-4242-87be-7023b2118e80 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.877516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6cb6f-0cbb-41a9-845a-9251bc706fc9 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.882315 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79ab93-011a-4dea-bbb7-9438266a92ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.883007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ab93-011a-4dea-bbb7-9438266a92ed admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.883272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ab93-011a-4dea-bbb7-9438266a92ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.883534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79ab93-011a-4dea-bbb7-9438266a92ed admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.884263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79ab93-011a-4dea-bbb7-9438266a92ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:54:54.884567 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79ab93-011a-4dea-bbb7-9438266a92ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.886235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79ab93-011a-4dea-bbb7-9438266a92ed admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.889646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 776/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:54:54.890451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed4eed-2c91-4242-87be-7023b2118e80 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.900389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed4eed-2c91-4242-87be-7023b2118e80 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.906526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9eacc-cde5-44d2-b626-5517c477ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.907088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 791/1567] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:54:54.907297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9eacc-cde5-44d2-b626-5517c477ac5a admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.907587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9eacc-cde5-44d2-b626-5517c477ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.907863 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce9eacc-cde5-44d2-b626-5517c477ac5a admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.907968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79ab93-011a-4dea-bbb7-9438266a92ed admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.908695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9eacc-cde5-44d2-b626-5517c477ac5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:54:54.908964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9eacc-cde5-44d2-b626-5517c477ac5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.910699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce9eacc-cde5-44d2-b626-5517c477ac5a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.919397 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79ab93-011a-4dea-bbb7-9438266a92ed admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.931585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 777/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:54:54.931868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb88a1f1-302a-4e45-ad3a-959dbc728c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.931987 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9eacc-cde5-44d2-b626-5517c477ac5a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.932078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a1f1-302a-4e45-ad3a-959dbc728c20 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.932078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a1f1-302a-4e45-ad3a-959dbc728c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.932078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb88a1f1-302a-4e45-ad3a-959dbc728c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.932078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88a1f1-302a-4e45-ad3a-959dbc728c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.932078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING py.warnings [None req-eb88a1f1-302a-4e45-ad3a-959dbc728c20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:54:54.932078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: warnings.warn(msg) Apr 06 12:54:54.932078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: Apr 06 12:54:54.932581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb88a1f1-302a-4e45-ad3a-959dbc728c20 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.935641 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce9eacc-cde5-44d2-b626-5517c477ac5a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:54.940623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c96a4c-0594-488c-aded-24f4596be2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:54.941271 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c96a4c-0594-488c-aded-24f4596be2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.941559 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c96a4c-0594-488c-aded-24f4596be2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.941862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c96a4c-0594-488c-aded-24f4596be2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.942575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c96a4c-0594-488c-aded-24f4596be2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:54.944551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c96a4c-0594-488c-aded-24f4596be2b6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:54.970006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 792/1569] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:54.970006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ec82-2d4d-470b-aa96-d5d48602cf92 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:54.970006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ec82-2d4d-470b-aa96-d5d48602cf92 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:54.970006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385ec82-2d4d-470b-aa96-d5d48602cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:54.977452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 778/1570] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:54.978725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c96a4c-0594-488c-aded-24f4596be2b6 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:54.997593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-c385ec82-2d4d-470b-aa96-d5d48602cf92 None None] MFA Rules not processed for user `d1ba82d333a54abaa2d025c0f6dffce7`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:54.999348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c385ec82-2d4d-470b-aa96-d5d48602cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:55.052436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c96a4c-0594-488c-aded-24f4596be2b6 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.058089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d2900-7dd8-44bf-9088-f5be2e9f50a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.058772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d2900-7dd8-44bf-9088-f5be2e9f50a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.059062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d2900-7dd8-44bf-9088-f5be2e9f50a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.059441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d2900-7dd8-44bf-9088-f5be2e9f50a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.060044 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d2900-7dd8-44bf-9088-f5be2e9f50a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.061865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING py.warnings [None req-e06d2900-7dd8-44bf-9088-f5be2e9f50a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:54:55.061865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: warnings.warn(msg) Apr 06 12:54:55.061865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: Apr 06 12:54:55.063115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d2900-7dd8-44bf-9088-f5be2e9f50a3 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.084901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 793/1571] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:55.084901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385ec82-2d4d-470b-aa96-d5d48602cf92 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.090985 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 779/1572] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:54:54 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.090985 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d2900-7dd8-44bf-9088-f5be2e9f50a3 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.096217 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385ec82-2d4d-470b-aa96-d5d48602cf92 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.103421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d2900-7dd8-44bf-9088-f5be2e9f50a3 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.103816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f67f-4941-40a3-8c0e-69d33e021b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.104735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f67f-4941-40a3-8c0e-69d33e021b2c admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.105024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f67f-4941-40a3-8c0e-69d33e021b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.105992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51f67f-4941-40a3-8c0e-69d33e021b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.106731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f67f-4941-40a3-8c0e-69d33e021b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:54:55.107031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f67f-4941-40a3-8c0e-69d33e021b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.109554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92887bf-0d4b-48de-97a3-12d4a557b234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.110114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51f67f-4941-40a3-8c0e-69d33e021b2c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.110290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92887bf-0d4b-48de-97a3-12d4a557b234 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.110551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92887bf-0d4b-48de-97a3-12d4a557b234 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.110840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92887bf-0d4b-48de-97a3-12d4a557b234 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.111546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92887bf-0d4b-48de-97a3-12d4a557b234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.113752 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92887bf-0d4b-48de-97a3-12d4a557b234 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.131306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 794/1573] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:54:55.131306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f67f-4941-40a3-8c0e-69d33e021b2c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.141869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51f67f-4941-40a3-8c0e-69d33e021b2c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.146815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7360e-e140-4867-bd2e-71cff5cbdd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.147484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7360e-e140-4867-bd2e-71cff5cbdd85 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.147802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7360e-e140-4867-bd2e-71cff5cbdd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.148057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7360e-e140-4867-bd2e-71cff5cbdd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.148356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 780/1574] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.148747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7360e-e140-4867-bd2e-71cff5cbdd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.149305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92887bf-0d4b-48de-97a3-12d4a557b234 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.150695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7360e-e140-4867-bd2e-71cff5cbdd85 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.178521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 795/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.179875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7360e-e140-4867-bd2e-71cff5cbdd85 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.230047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92887bf-0d4b-48de-97a3-12d4a557b234 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.248064 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7360e-e140-4867-bd2e-71cff5cbdd85 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.255020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623a113-aa7f-4634-b814-4c2922cdd45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.255693 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a113-aa7f-4634-b814-4c2922cdd45f admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.255974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a113-aa7f-4634-b814-4c2922cdd45f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.256767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623a113-aa7f-4634-b814-4c2922cdd45f admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.257046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623a113-aa7f-4634-b814-4c2922cdd45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.259215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623a113-aa7f-4634-b814-4c2922cdd45f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.283203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 796/1576] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.283203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623a113-aa7f-4634-b814-4c2922cdd45f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.291167 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623a113-aa7f-4634-b814-4c2922cdd45f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.292557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16785b0-5951-494d-a263-79321979f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.293207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16785b0-5951-494d-a263-79321979f654 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.294290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16785b0-5951-494d-a263-79321979f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.294290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16785b0-5951-494d-a263-79321979f654 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.294494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16785b0-5951-494d-a263-79321979f654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.296947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f10a03-33f2-4261-89c1-a786be0fd31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.297317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16785b0-5951-494d-a263-79321979f654 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.297645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f10a03-33f2-4261-89c1-a786be0fd31c admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.297930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f10a03-33f2-4261-89c1-a786be0fd31c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.298204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f10a03-33f2-4261-89c1-a786be0fd31c admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.298892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f10a03-33f2-4261-89c1-a786be0fd31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.300810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f10a03-33f2-4261-89c1-a786be0fd31c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.327203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 797/1577] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.327450 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 781/1578] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/projects => generated 389 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.327546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f10a03-33f2-4261-89c1-a786be0fd31c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.330532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7ca3-7ca2-4b48-aa5e-8ee96a1e8d55 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.330532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7ca3-7ca2-4b48-aa5e-8ee96a1e8d55 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.330753 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7ca3-7ca2-4b48-aa5e-8ee96a1e8d55 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.334122 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 782/1579] 10.222.0.23 () {54 vars in 960 bytes} [Wed Apr 6 12:54:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:54:55.334978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e7ca3-7ca2-4b48-aa5e-8ee96a1e8d55 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.347763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f10a03-33f2-4261-89c1-a786be0fd31c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.401342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e7ca3-7ca2-4b48-aa5e-8ee96a1e8d55 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.406491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67585-f022-476b-bc6d-184cdfb246db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.407150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67585-f022-476b-bc6d-184cdfb246db admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.407430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67585-f022-476b-bc6d-184cdfb246db admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.407706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c67585-f022-476b-bc6d-184cdfb246db admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.408408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c67585-f022-476b-bc6d-184cdfb246db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.410406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c67585-f022-476b-bc6d-184cdfb246db admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.415830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f41c33-c9a4-4126-9ec5-077a6c4a2c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.416513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41c33-c9a4-4126-9ec5-077a6c4a2c76 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.416796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41c33-c9a4-4126-9ec5-077a6c4a2c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.417071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41c33-c9a4-4126-9ec5-077a6c4a2c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.417832 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f41c33-c9a4-4126-9ec5-077a6c4a2c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.419457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f41c33-c9a4-4126-9ec5-077a6c4a2c76 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.432152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 798/1580] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.434404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f41c33-c9a4-4126-9ec5-077a6c4a2c76 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.441877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 783/1581] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.442700 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67585-f022-476b-bc6d-184cdfb246db admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.446307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f41c33-c9a4-4126-9ec5-077a6c4a2c76 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.504677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8fcd8-fbda-4fc7-87f8-38518af583ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.505262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8fcd8-fbda-4fc7-87f8-38518af583ee admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.505543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8fcd8-fbda-4fc7-87f8-38518af583ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.505858 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8fcd8-fbda-4fc7-87f8-38518af583ee admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.506546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8fcd8-fbda-4fc7-87f8-38518af583ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.508483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8fcd8-fbda-4fc7-87f8-38518af583ee admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.508634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c67585-f022-476b-bc6d-184cdfb246db admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.515160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcda33-5fd4-44bf-b2c4-800f885c5e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.515833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcda33-5fd4-44bf-b2c4-800f885c5e85 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.516117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcda33-5fd4-44bf-b2c4-800f885c5e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.516391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcda33-5fd4-44bf-b2c4-800f885c5e85 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.517088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcda33-5fd4-44bf-b2c4-800f885c5e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.519091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcda33-5fd4-44bf-b2c4-800f885c5e85 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.529636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 799/1582] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.532870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8fcd8-fbda-4fc7-87f8-38518af583ee admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.540975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8fcd8-fbda-4fc7-87f8-38518af583ee admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.544403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 784/1583] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.545767 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcda33-5fd4-44bf-b2c4-800f885c5e85 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.555648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a6524-ea22-41d7-88bd-27dacf2bb41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.555912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcda33-5fd4-44bf-b2c4-800f885c5e85 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.556324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a6524-ea22-41d7-88bd-27dacf2bb41c admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.556599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a6524-ea22-41d7-88bd-27dacf2bb41c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.556878 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a6524-ea22-41d7-88bd-27dacf2bb41c admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.557630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a6524-ea22-41d7-88bd-27dacf2bb41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.559254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a6524-ea22-41d7-88bd-27dacf2bb41c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.563946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8800-a110-4f14-bec7-7dedde6874b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.563946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8800-a110-4f14-bec7-7dedde6874b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.564271 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8800-a110-4f14-bec7-7dedde6874b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.564430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8800-a110-4f14-bec7-7dedde6874b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.565144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d8800-a110-4f14-bec7-7dedde6874b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.566834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d8800-a110-4f14-bec7-7dedde6874b7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.577653 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 800/1584] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.578393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a6524-ea22-41d7-88bd-27dacf2bb41c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.578564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 785/1585] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.579711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c164764-0ba9-4e77-841c-600334794923 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.579994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c164764-0ba9-4e77-841c-600334794923 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.580269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c164764-0ba9-4e77-841c-600334794923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.600059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a6524-ea22-41d7-88bd-27dacf2bb41c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.600300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3c164764-0ba9-4e77-841c-600334794923 None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:55.601268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3c164764-0ba9-4e77-841c-600334794923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:55.605184 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbce83c-072c-46cc-b5f7-ea7814bf4c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.605904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbce83c-072c-46cc-b5f7-ea7814bf4c47 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.606191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbce83c-072c-46cc-b5f7-ea7814bf4c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.606472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbce83c-072c-46cc-b5f7-ea7814bf4c47 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.607714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbce83c-072c-46cc-b5f7-ea7814bf4c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.610437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbce83c-072c-46cc-b5f7-ea7814bf4c47 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.636608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 801/1586] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.636608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbce83c-072c-46cc-b5f7-ea7814bf4c47 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.645097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbce83c-072c-46cc-b5f7-ea7814bf4c47 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.649983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8e768-558e-41d2-801e-1515b03ea3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.650638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8e768-558e-41d2-801e-1515b03ea3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.650913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8e768-558e-41d2-801e-1515b03ea3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.651181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8e768-558e-41d2-801e-1515b03ea3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.651903 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8e768-558e-41d2-801e-1515b03ea3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.653558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8e768-558e-41d2-801e-1515b03ea3c2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.667810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 802/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.668665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8e768-558e-41d2-801e-1515b03ea3c2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.674102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 786/1588] 10.222.0.23 () {58 vars in 1057 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:55.674964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c164764-0ba9-4e77-841c-600334794923 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.680265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8e768-558e-41d2-801e-1515b03ea3c2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.684952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4acee1-9b19-49d3-be76-b65e2ff25e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.686059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c164764-0ba9-4e77-841c-600334794923 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.686265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4acee1-9b19-49d3-be76-b65e2ff25e88 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.686513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4acee1-9b19-49d3-be76-b65e2ff25e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.686783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4acee1-9b19-49d3-be76-b65e2ff25e88 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.687602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4acee1-9b19-49d3-be76-b65e2ff25e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.689516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4acee1-9b19-49d3-be76-b65e2ff25e88 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.692291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c90eeb-5d6c-4297-b29e-89be53bffc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.692956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c90eeb-5d6c-4297-b29e-89be53bffc27 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.693231 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c90eeb-5d6c-4297-b29e-89be53bffc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.693502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c90eeb-5d6c-4297-b29e-89be53bffc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.694263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c90eeb-5d6c-4297-b29e-89be53bffc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.695876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c90eeb-5d6c-4297-b29e-89be53bffc27 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.707725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 787/1589] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.708739 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c90eeb-5d6c-4297-b29e-89be53bffc27 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.722166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 803/1590] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:54:55 2022] POST /identity/v3/users => generated 303 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:55.722456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c90eeb-5d6c-4297-b29e-89be53bffc27 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.722622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4acee1-9b19-49d3-be76-b65e2ff25e88 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.724033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7ee21-343c-4480-8ca8-28734b7d54f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.724697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7ee21-343c-4480-8ca8-28734b7d54f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.724976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7ee21-343c-4480-8ca8-28734b7d54f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.725248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7ee21-343c-4480-8ca8-28734b7d54f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.726013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7ee21-343c-4480-8ca8-28734b7d54f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.727626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7ee21-343c-4480-8ca8-28734b7d54f6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.729257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4acee1-9b19-49d3-be76-b65e2ff25e88 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.734304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb8456-ef68-4376-8258-a9d6fe2e52a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.734974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb8456-ef68-4376-8258-a9d6fe2e52a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.735257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb8456-ef68-4376-8258-a9d6fe2e52a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.735532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb8456-ef68-4376-8258-a9d6fe2e52a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.736253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb8456-ef68-4376-8258-a9d6fe2e52a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.740816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb8456-ef68-4376-8258-a9d6fe2e52a1 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.741004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 788/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.741004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7ee21-343c-4480-8ca8-28734b7d54f6 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.752436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 804/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.752436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb8456-ef68-4376-8258-a9d6fe2e52a1 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.752755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7ee21-343c-4480-8ca8-28734b7d54f6 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.757294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1cf9-ae34-4927-900b-1eaff3d44513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.757925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1cf9-ae34-4927-900b-1eaff3d44513 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.758229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1cf9-ae34-4927-900b-1eaff3d44513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.758504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f1cf9-ae34-4927-900b-1eaff3d44513 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.759222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f1cf9-ae34-4927-900b-1eaff3d44513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.760869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f1cf9-ae34-4927-900b-1eaff3d44513 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.763107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb8456-ef68-4376-8258-a9d6fe2e52a1 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.769906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a601e2-6f21-40c1-a014-77ecc411b9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.770574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a601e2-6f21-40c1-a014-77ecc411b9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.770856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a601e2-6f21-40c1-a014-77ecc411b9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.771134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a601e2-6f21-40c1-a014-77ecc411b9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.771890 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a601e2-6f21-40c1-a014-77ecc411b9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.772509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 789/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.772509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1cf9-ae34-4927-900b-1eaff3d44513 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.776329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a601e2-6f21-40c1-a014-77ecc411b9c2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.784167 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f1cf9-ae34-4927-900b-1eaff3d44513 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.786262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 805/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.786972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a601e2-6f21-40c1-a014-77ecc411b9c2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.789943 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cd67d-3026-4cdd-a55d-a5816215e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.790925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cd67d-3026-4cdd-a55d-a5816215e328 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.791209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cd67d-3026-4cdd-a55d-a5816215e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.791487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cd67d-3026-4cdd-a55d-a5816215e328 admin admin] PATH_INFO: `/v3/projects/2001e305e71946f1a13810cf528cca0d/users/c7099ad53d0e4d328364905461c8b72f/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.801688 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a601e2-6f21-40c1-a014-77ecc411b9c2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.807251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b20ae1-4984-47c3-b167-0b9e1f83da24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.807897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b20ae1-4984-47c3-b167-0b9e1f83da24 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.808175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b20ae1-4984-47c3-b167-0b9e1f83da24 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.808340 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cd67d-3026-4cdd-a55d-a5816215e328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2001e305e71946f1a13810cf528cca0d, user_id=c7099ad53d0e4d328364905461c8b72f, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.808448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b20ae1-4984-47c3-b167-0b9e1f83da24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.811702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cd67d-3026-4cdd-a55d-a5816215e328 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.828290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 790/1595] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:54:55 2022] PUT /identity/v3/projects/2001e305e71946f1a13810cf528cca0d/users/c7099ad53d0e4d328364905461c8b72f/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:55.830026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cd67d-3026-4cdd-a55d-a5816215e328 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.870123 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b20ae1-4984-47c3-b167-0b9e1f83da24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.871910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b20ae1-4984-47c3-b167-0b9e1f83da24 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.882224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 806/1596] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:54:55.883216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b20ae1-4984-47c3-b167-0b9e1f83da24 service nova] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.894292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b20ae1-4984-47c3-b167-0b9e1f83da24 service nova] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.914336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cd67d-3026-4cdd-a55d-a5816215e328 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.921495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8d1b3-a79a-4167-95fe-68ad6093531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.922220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8d1b3-a79a-4167-95fe-68ad6093531d admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.922661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8d1b3-a79a-4167-95fe-68ad6093531d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.922838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8d1b3-a79a-4167-95fe-68ad6093531d admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.923497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8d1b3-a79a-4167-95fe-68ad6093531d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.925135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8d1b3-a79a-4167-95fe-68ad6093531d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.939445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 791/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.939445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8d1b3-a79a-4167-95fe-68ad6093531d admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.951865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8d1b3-a79a-4167-95fe-68ad6093531d admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.957812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be627b5b-0d83-45f6-bb77-1b9d19e9d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.958508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be627b5b-0d83-45f6-bb77-1b9d19e9d6fd admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.958778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be627b5b-0d83-45f6-bb77-1b9d19e9d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.959117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be627b5b-0d83-45f6-bb77-1b9d19e9d6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.959846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be627b5b-0d83-45f6-bb77-1b9d19e9d6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.961483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be627b5b-0d83-45f6-bb77-1b9d19e9d6fd admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.962038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7f7b2-920d-4aa3-ac15-507ce817c763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.962841 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7f7b2-920d-4aa3-ac15-507ce817c763 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.963124 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7f7b2-920d-4aa3-ac15-507ce817c763 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.963577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7f7b2-920d-4aa3-ac15-507ce817c763 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.964312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7f7b2-920d-4aa3-ac15-507ce817c763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:55.965944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7f7b2-920d-4aa3-ac15-507ce817c763 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:55.974811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 792/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.974811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be627b5b-0d83-45f6-bb77-1b9d19e9d6fd admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.979818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 807/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:55.979818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7f7b2-920d-4aa3-ac15-507ce817c763 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:55.985762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be627b5b-0d83-45f6-bb77-1b9d19e9d6fd admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.991199 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7f7b2-920d-4aa3-ac15-507ce817c763 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:55.992431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5c02-9840-413d-9848-1029a3e7afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.992431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5c02-9840-413d-9848-1029a3e7afd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.993622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5c02-9840-413d-9848-1029a3e7afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.993905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5c02-9840-413d-9848-1029a3e7afd6 admin admin] PATH_INFO: `/v3/projects/4de1d2967b8744e4bccc57d7bccd32ac/users/492be559e42c4080b276b30d3d7290b4/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:55.998058 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a510961-864f-4a28-9bf4-a3f028b203c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:55.999042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a510961-864f-4a28-9bf4-a3f028b203c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:55.999389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a510961-864f-4a28-9bf4-a3f028b203c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:55.999764 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a510961-864f-4a28-9bf4-a3f028b203c2 admin admin] PATH_INFO: `/v3/projects/b4082715dd2c4d6f9b9a2691c78a1cd2/users/1db7cf357e20453fa62973ddcbff48ab/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.012024 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5c02-9840-413d-9848-1029a3e7afd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de1d2967b8744e4bccc57d7bccd32ac, user_id=492be559e42c4080b276b30d3d7290b4, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.014810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a510961-864f-4a28-9bf4-a3f028b203c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4082715dd2c4d6f9b9a2691c78a1cd2, user_id=1db7cf357e20453fa62973ddcbff48ab, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.015280 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5c02-9840-413d-9848-1029a3e7afd6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:56.017617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a510961-864f-4a28-9bf4-a3f028b203c2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:56.030568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 793/1600] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:54:55 2022] PUT /identity/v3/projects/4de1d2967b8744e4bccc57d7bccd32ac/users/492be559e42c4080b276b30d3d7290b4/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:56.031647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5c02-9840-413d-9848-1029a3e7afd6 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:56.044364 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 808/1601] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:54:55 2022] PUT /identity/v3/projects/b4082715dd2c4d6f9b9a2691c78a1cd2/users/1db7cf357e20453fa62973ddcbff48ab/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:56.046159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd0578-2289-4860-a6f2-ad34018746b0 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.046530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd0578-2289-4860-a6f2-ad34018746b0 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.046873 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd0578-2289-4860-a6f2-ad34018746b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.084411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-97bd0578-2289-4860-a6f2-ad34018746b0 None None] MFA Rules not processed for user `c7099ad53d0e4d328364905461c8b72f`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:56.085790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-97bd0578-2289-4860-a6f2-ad34018746b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:56.105179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5c02-9840-413d-9848-1029a3e7afd6 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:56.157198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 809/1602] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:56.158065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd0578-2289-4860-a6f2-ad34018746b0 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:56.165209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83aa5a-6ed5-4923-85f8-3e6a72bd27a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:56.166024 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83aa5a-6ed5-4923-85f8-3e6a72bd27a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.166239 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83aa5a-6ed5-4923-85f8-3e6a72bd27a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.166464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83aa5a-6ed5-4923-85f8-3e6a72bd27a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.167264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83aa5a-6ed5-4923-85f8-3e6a72bd27a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.168855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83aa5a-6ed5-4923-85f8-3e6a72bd27a9 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:56.184073 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 794/1603] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:56.184073 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83aa5a-6ed5-4923-85f8-3e6a72bd27a9 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:56.194101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83aa5a-6ed5-4923-85f8-3e6a72bd27a9 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:56.202220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dba42-f88f-439e-b159-85a51ab8e263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:56.202777 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dba42-f88f-439e-b159-85a51ab8e263 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.203061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dba42-f88f-439e-b159-85a51ab8e263 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.203338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41dba42-f88f-439e-b159-85a51ab8e263 admin admin] PATH_INFO: `/v3/projects/ced8aa6655764afdafefdfa6e3726d63/users/c9e498e3dae54ffab54d93958bfc2ef4/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.221435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41dba42-f88f-439e-b159-85a51ab8e263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced8aa6655764afdafefdfa6e3726d63, user_id=c9e498e3dae54ffab54d93958bfc2ef4, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.224196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41dba42-f88f-439e-b159-85a51ab8e263 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:56.229762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd0578-2289-4860-a6f2-ad34018746b0 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:56.238396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a7c9b-66c7-4654-b293-b13c9bc2a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:56.238396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a7c9b-66c7-4654-b293-b13c9bc2a8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.238396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a7c9b-66c7-4654-b293-b13c9bc2a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.238396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a7c9b-66c7-4654-b293-b13c9bc2a8f9 admin admin] PATH_INFO: `/v3/projects/c531ac9fcd864b999248adc77b852776/users/1d465ffe97954b51bda034b2b8e0555c/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.240906 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 795/1604] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:54:56 2022] PUT /identity/v3/projects/ced8aa6655764afdafefdfa6e3726d63/users/c9e498e3dae54ffab54d93958bfc2ef4/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:56.242261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dba42-f88f-439e-b159-85a51ab8e263 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:56.254153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a7c9b-66c7-4654-b293-b13c9bc2a8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c531ac9fcd864b999248adc77b852776, user_id=1d465ffe97954b51bda034b2b8e0555c, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.256983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a7c9b-66c7-4654-b293-b13c9bc2a8f9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:56.271138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 810/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:54:56 2022] PUT /identity/v3/projects/c531ac9fcd864b999248adc77b852776/users/1d465ffe97954b51bda034b2b8e0555c/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:56.272147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98cc73-b23d-4b09-a832-f36c63597b64 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.272445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98cc73-b23d-4b09-a832-f36c63597b64 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.272719 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98cc73-b23d-4b09-a832-f36c63597b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.302775 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-4e98cc73-b23d-4b09-a832-f36c63597b64 None None] MFA Rules not processed for user `492be559e42c4080b276b30d3d7290b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:56.304234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4e98cc73-b23d-4b09-a832-f36c63597b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:56.315741 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41dba42-f88f-439e-b159-85a51ab8e263 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:56.377446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 811/1606] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:56.378983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd200ebb-f6fe-4b27-af43-b3094817ee1e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.379281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd200ebb-f6fe-4b27-af43-b3094817ee1e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.379563 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd200ebb-f6fe-4b27-af43-b3094817ee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.385798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccc961-5a2d-407d-a92e-a009cea8fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:56.386483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccc961-5a2d-407d-a92e-a009cea8fe2d admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.386767 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccc961-5a2d-407d-a92e-a009cea8fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.387053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccc961-5a2d-407d-a92e-a009cea8fe2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.387786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccc961-5a2d-407d-a92e-a009cea8fe2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.390864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccc961-5a2d-407d-a92e-a009cea8fe2d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:56.407628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 796/1607] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:56.407628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64292558-34ae-40b3-bd50-f3da2c48c769 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.407628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64292558-34ae-40b3-bd50-f3da2c48c769 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.407628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64292558-34ae-40b3-bd50-f3da2c48c769 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.408153 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 797/1608] 10.222.0.23 () {54 vars in 912 bytes} [Wed Apr 6 12:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:54:56.408805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64292558-34ae-40b3-bd50-f3da2c48c769 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:56.411439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-cd200ebb-f6fe-4b27-af43-b3094817ee1e None None] MFA Rules not processed for user `1db7cf357e20453fa62973ddcbff48ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:56.412643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cd200ebb-f6fe-4b27-af43-b3094817ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:56.463541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64292558-34ae-40b3-bd50-f3da2c48c769 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:56.467938 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169200d0-9d7c-4a98-a929-2239c50e3cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:56.468606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169200d0-9d7c-4a98-a929-2239c50e3cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.468892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169200d0-9d7c-4a98-a929-2239c50e3cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.469166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169200d0-9d7c-4a98-a929-2239c50e3cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.478471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 812/1609] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:56.479292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd200ebb-f6fe-4b27-af43-b3094817ee1e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:56.495972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd200ebb-f6fe-4b27-af43-b3094817ee1e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:56.504989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ba8ea-58b1-4177-bd90-948331740b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:56.506515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ba8ea-58b1-4177-bd90-948331740b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.507004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ba8ea-58b1-4177-bd90-948331740b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.507483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ba8ea-58b1-4177-bd90-948331740b74 admin admin] PATH_INFO: `/v3/projects/03051cb3880e4976b0d195248d3000a6/users/c07f9210231742ffac3dae4b75887d66/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.526672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ba8ea-58b1-4177-bd90-948331740b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03051cb3880e4976b0d195248d3000a6, user_id=c07f9210231742ffac3dae4b75887d66, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.531432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ba8ea-58b1-4177-bd90-948331740b74 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:56.541211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169200d0-9d7c-4a98-a929-2239c50e3cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.543270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169200d0-9d7c-4a98-a929-2239c50e3cc5 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:56.548359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 813/1610] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:54:56 2022] PUT /identity/v3/projects/03051cb3880e4976b0d195248d3000a6/users/c07f9210231742ffac3dae4b75887d66/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:56.550834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22d1f6-b88c-4096-ac2e-737e1904e123 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.550834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22d1f6-b88c-4096-ac2e-737e1904e123 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.551070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22d1f6-b88c-4096-ac2e-737e1904e123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.557837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 798/1611] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:54:56.559635 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509244c-df3b-4d5d-b780-d5216a62871f None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.559933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509244c-df3b-4d5d-b780-d5216a62871f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.560955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509244c-df3b-4d5d-b780-d5216a62871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.570225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-af22d1f6-b88c-4096-ac2e-737e1904e123 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:56.571440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-af22d1f6-b88c-4096-ac2e-737e1904e123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:56.582469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d509244c-df3b-4d5d-b780-d5216a62871f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:56.584119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d509244c-df3b-4d5d-b780-d5216a62871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:56.647660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 799/1612] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:56.649449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0692-f668-43f8-9112-6d79b23b4147 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.649894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0692-f668-43f8-9112-6d79b23b4147 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.650104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 814/1613] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:56.653299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef0692-f668-43f8-9112-6d79b23b4147 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.654141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22d1f6-b88c-4096-ac2e-737e1904e123 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:56.654740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 800/1614] 10.222.0.23 () {54 vars in 960 bytes} [Wed Apr 6 12:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:54:56.654740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7a9ad-8b7c-4817-a0fd-a5961c981773 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.654740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7a9ad-8b7c-4817-a0fd-a5961c981773 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.655017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7a9ad-8b7c-4817-a0fd-a5961c981773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.676101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f7c7a9ad-8b7c-4817-a0fd-a5961c981773 None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:56.679165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f7c7a9ad-8b7c-4817-a0fd-a5961c981773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:56.679608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22d1f6-b88c-4096-ac2e-737e1904e123 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:56.688584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c187f5-4229-4092-a8f2-8772a58415d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:56.690083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c187f5-4229-4092-a8f2-8772a58415d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.690565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c187f5-4229-4092-a8f2-8772a58415d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.691054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c187f5-4229-4092-a8f2-8772a58415d6 admin admin] PATH_INFO: `/v3/projects/85f42e9cb8e7446fb4b8f9a9d823cbcf/users/ef833e9a07b1418f9b446dc72dd1f258/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.720201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c187f5-4229-4092-a8f2-8772a58415d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f42e9cb8e7446fb4b8f9a9d823cbcf, user_id=ef833e9a07b1418f9b446dc72dd1f258, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.725451 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c187f5-4229-4092-a8f2-8772a58415d6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:56.747070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 815/1615] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:54:56 2022] PUT /identity/v3/projects/85f42e9cb8e7446fb4b8f9a9d823cbcf/users/ef833e9a07b1418f9b446dc72dd1f258/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:56.748984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27531-2575-4e96-9465-3c2369761554 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.749284 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27531-2575-4e96-9465-3c2369761554 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.749560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27531-2575-4e96-9465-3c2369761554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.768523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-97c27531-2575-4e96-9465-3c2369761554 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:56.769793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-97c27531-2575-4e96-9465-3c2369761554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:56.782646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 801/1616] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:56.783726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5ba1-b50e-4261-a62b-61e7dec0c3f0 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.784078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5ba1-b50e-4261-a62b-61e7dec0c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.784359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac5ba1-b50e-4261-a62b-61e7dec0c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.804888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f4ac5ba1-b50e-4261-a62b-61e7dec0c3f0 None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:56.806123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f4ac5ba1-b50e-4261-a62b-61e7dec0c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:56.854521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 816/1617] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:56.855690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c27531-2575-4e96-9465-3c2369761554 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:56.889467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 802/1618] 10.222.0.23 () {58 vars in 1057 bytes} [Wed Apr 6 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:56.890651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5ba1-b50e-4261-a62b-61e7dec0c3f0 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:56.934893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c27531-2575-4e96-9465-3c2369761554 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:56.939446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cfafd-6020-439b-aa7f-2ca0fff45195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:56.940217 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cfafd-6020-439b-aa7f-2ca0fff45195 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.940971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cfafd-6020-439b-aa7f-2ca0fff45195 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.940971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cfafd-6020-439b-aa7f-2ca0fff45195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.953051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac5ba1-b50e-4261-a62b-61e7dec0c3f0 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:56.953391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cfafd-6020-439b-aa7f-2ca0fff45195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.954118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cfafd-6020-439b-aa7f-2ca0fff45195 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:56.959170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534da8f8-1f8d-477b-92db-190446fb7de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:56.960134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534da8f8-1f8d-477b-92db-190446fb7de0 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.960134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534da8f8-1f8d-477b-92db-190446fb7de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.960409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534da8f8-1f8d-477b-92db-190446fb7de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.965814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 817/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:54:56.967846 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc40b76-0d2e-4fc2-b2f6-90a9baee7c0d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:56.968224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc40b76-0d2e-4fc2-b2f6-90a9baee7c0d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:56.968582 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc40b76-0d2e-4fc2-b2f6-90a9baee7c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:56.976517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534da8f8-1f8d-477b-92db-190446fb7de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:56.978420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534da8f8-1f8d-477b-92db-190446fb7de0 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:57.002928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-edc40b76-0d2e-4fc2-b2f6-90a9baee7c0d None None] MFA Rules not processed for user `ef833e9a07b1418f9b446dc72dd1f258`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:57.004371 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-edc40b76-0d2e-4fc2-b2f6-90a9baee7c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:57.006123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 803/1620] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:54:57.011068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534da8f8-1f8d-477b-92db-190446fb7de0 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:57.116737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534da8f8-1f8d-477b-92db-190446fb7de0 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:57.128222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff60a-78a4-47a4-9c0d-442d53924d55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:57.128920 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff60a-78a4-47a4-9c0d-442d53924d55 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:57.129211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff60a-78a4-47a4-9c0d-442d53924d55 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:57.129491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff60a-78a4-47a4-9c0d-442d53924d55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:57.140224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 818/1621] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:57.141411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc40b76-0d2e-4fc2-b2f6-90a9baee7c0d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:57.150990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ff60a-78a4-47a4-9c0d-442d53924d55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:57.152622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ff60a-78a4-47a4-9c0d-442d53924d55 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:57.166578 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 804/1622] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:54:57.167612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff60a-78a4-47a4-9c0d-442d53924d55 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:57.180903 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ff60a-78a4-47a4-9c0d-442d53924d55 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:57.187945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc40b76-0d2e-4fc2-b2f6-90a9baee7c0d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:57.198326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7645-11cc-40d2-b0c4-8e7b5285180f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:57.200140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7645-11cc-40d2-b0c4-8e7b5285180f service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:57.200494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7645-11cc-40d2-b0c4-8e7b5285180f service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:57.200816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff7645-11cc-40d2-b0c4-8e7b5285180f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:57.211174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c21a45-38f8-4928-8296-569d1a02acf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:57.212106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c21a45-38f8-4928-8296-569d1a02acf7 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:57.212564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c21a45-38f8-4928-8296-569d1a02acf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:57.212939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c21a45-38f8-4928-8296-569d1a02acf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:57.233835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c21a45-38f8-4928-8296-569d1a02acf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:57.238235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c21a45-38f8-4928-8296-569d1a02acf7 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:57.263865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 819/1623] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:54:57.269205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c21a45-38f8-4928-8296-569d1a02acf7 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:57.301537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c21a45-38f8-4928-8296-569d1a02acf7 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:57.314082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58bb36-78d4-4c74-9c14-d03dd3489c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:57.315772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58bb36-78d4-4c74-9c14-d03dd3489c4b admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:57.316119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58bb36-78d4-4c74-9c14-d03dd3489c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:57.316348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58bb36-78d4-4c74-9c14-d03dd3489c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:57.317493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58bb36-78d4-4c74-9c14-d03dd3489c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:57.328489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58bb36-78d4-4c74-9c14-d03dd3489c4b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:57.359267 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff7645-11cc-40d2-b0c4-8e7b5285180f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:57.363050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff7645-11cc-40d2-b0c4-8e7b5285180f service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:57.392766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 820/1624] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:54:57 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:57.402556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 805/1625] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:54:57.418672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58bb36-78d4-4c74-9c14-d03dd3489c4b admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:57.539314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58bb36-78d4-4c74-9c14-d03dd3489c4b admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:57.554638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d6af1-fb95-4686-962e-eed510f5c531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:57.555424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d6af1-fb95-4686-962e-eed510f5c531 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:57.555784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d6af1-fb95-4686-962e-eed510f5c531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:57.556127 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d6af1-fb95-4686-962e-eed510f5c531 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:57.556932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d6af1-fb95-4686-962e-eed510f5c531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:57.559219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d6af1-fb95-4686-962e-eed510f5c531 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:57.601201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 821/1626] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:54:57 2022] POST /identity/v3/users => generated 309 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:54:57.605283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7645-11cc-40d2-b0c4-8e7b5285180f service nova] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:57.621541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff7645-11cc-40d2-b0c4-8e7b5285180f service nova] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:57.639064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d0bb-0059-4f77-98c4-d14593ca3313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:57.639885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d0bb-0059-4f77-98c4-d14593ca3313 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:57.640180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d0bb-0059-4f77-98c4-d14593ca3313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:57.640466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d0bb-0059-4f77-98c4-d14593ca3313 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:57.641211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d0bb-0059-4f77-98c4-d14593ca3313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:57.643617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d0bb-0059-4f77-98c4-d14593ca3313 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:57.668143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 806/1627] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:57.672520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d6af1-fb95-4686-962e-eed510f5c531 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:57.694807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d6af1-fb95-4686-962e-eed510f5c531 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:57.710701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b7d03-bc2f-451e-9b8b-013964747349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:57.711635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b7d03-bc2f-451e-9b8b-013964747349 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:57.711923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b7d03-bc2f-451e-9b8b-013964747349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:57.712200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b7d03-bc2f-451e-9b8b-013964747349 admin admin] PATH_INFO: `/v3/projects/f0f9dd9773dc44778f9c8a3af8fd234a/users/4a66ebeb62b9460c92b4fbf534b68449/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:57.749059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b7d03-bc2f-451e-9b8b-013964747349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f9dd9773dc44778f9c8a3af8fd234a, user_id=4a66ebeb62b9460c92b4fbf534b68449, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:57.751945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b7d03-bc2f-451e-9b8b-013964747349 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:57.787330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 822/1628] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:54:57 2022] PUT /identity/v3/projects/f0f9dd9773dc44778f9c8a3af8fd234a/users/4a66ebeb62b9460c92b4fbf534b68449/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:57.791456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d0bb-0059-4f77-98c4-d14593ca3313 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:57.806827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d0bb-0059-4f77-98c4-d14593ca3313 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:57.841249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b7d03-bc2f-451e-9b8b-013964747349 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:57.927089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e345ae9-c2d5-460f-b2a2-837e21d8ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:57.927627 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e345ae9-c2d5-460f-b2a2-837e21d8ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:57.927914 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e345ae9-c2d5-460f-b2a2-837e21d8ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:57.928189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e345ae9-c2d5-460f-b2a2-837e21d8ea91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:57.928926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e345ae9-c2d5-460f-b2a2-837e21d8ea91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:57.932155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e345ae9-c2d5-460f-b2a2-837e21d8ea91 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:57.945114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 807/1629] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:54:57.953241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e345ae9-c2d5-460f-b2a2-837e21d8ea91 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:57.977447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e345ae9-c2d5-460f-b2a2-837e21d8ea91 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:57.984260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909750c1-908d-4de7-9aaa-261323f15dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:57.985478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909750c1-908d-4de7-9aaa-261323f15dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:57.986355 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909750c1-908d-4de7-9aaa-261323f15dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:57.988042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909750c1-908d-4de7-9aaa-261323f15dd0 admin admin] PATH_INFO: `/v3/projects/f0f9dd9773dc44778f9c8a3af8fd234a/users/4a66ebeb62b9460c92b4fbf534b68449/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:57.998465 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909750c1-908d-4de7-9aaa-261323f15dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f9dd9773dc44778f9c8a3af8fd234a, user_id=4a66ebeb62b9460c92b4fbf534b68449, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:58.010171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909750c1-908d-4de7-9aaa-261323f15dd0 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:58.012828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b7d03-bc2f-451e-9b8b-013964747349 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:58.025678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 808/1630] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:54:57 2022] PUT /identity/v3/projects/f0f9dd9773dc44778f9c8a3af8fd234a/users/4a66ebeb62b9460c92b4fbf534b68449/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:58.039923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ba31-0cfc-41e2-a65b-8d759f22afeb None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:58.040489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ba31-0cfc-41e2-a65b-8d759f22afeb None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:58.040962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ba31-0cfc-41e2-a65b-8d759f22afeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:58.048875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14413a50-803d-4787-a364-6a591b83ca75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:58.049939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413a50-803d-4787-a364-6a591b83ca75 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:58.050292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413a50-803d-4787-a364-6a591b83ca75 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:58.050604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14413a50-803d-4787-a364-6a591b83ca75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:58.121286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-0c73ba31-0cfc-41e2-a65b-8d759f22afeb None None] MFA Rules not processed for user `4a66ebeb62b9460c92b4fbf534b68449`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:58.125072 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0c73ba31-0cfc-41e2-a65b-8d759f22afeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:58.179500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413a50-803d-4787-a364-6a591b83ca75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:58.181611 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14413a50-803d-4787-a364-6a591b83ca75 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:58.194972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 823/1631] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:54:58.293698 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d70a-90ad-46cd-99fd-a2bd41057c3e None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:58.298703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d70a-90ad-46cd-99fd-a2bd41057c3e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:58.300331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551d70a-90ad-46cd-99fd-a2bd41057c3e None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:58.309053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 824/1632] 10.222.0.23 () {54 vars in 912 bytes} [Wed Apr 6 12:54:58 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:54:58.317027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d918-ac6b-4e9a-b1e4-4bc1a0a78a53 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:58.317976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d918-ac6b-4e9a-b1e4-4bc1a0a78a53 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:58.320627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d918-ac6b-4e9a-b1e4-4bc1a0a78a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:58.336233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 809/1633] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:54:58.344873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ba31-0cfc-41e2-a65b-8d759f22afeb None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:58.374150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-bbb9d918-ac6b-4e9a-b1e4-4bc1a0a78a53 None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:58.375378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bbb9d918-ac6b-4e9a-b1e4-4bc1a0a78a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:58.511032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ba31-0cfc-41e2-a65b-8d759f22afeb None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:58.521704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d9ff4-04a2-4347-8680-3e365a1e3c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:58.522571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d9ff4-04a2-4347-8680-3e365a1e3c62 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:58.523030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d9ff4-04a2-4347-8680-3e365a1e3c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:58.523354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d9ff4-04a2-4347-8680-3e365a1e3c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:58.544057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 825/1634] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:54:58.545702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087531-c943-48c7-90cb-6e1cdc2d8d8a None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:58.546005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087531-c943-48c7-90cb-6e1cdc2d8d8a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:58.546381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087531-c943-48c7-90cb-6e1cdc2d8d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:58.548659 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d9ff4-04a2-4347-8680-3e365a1e3c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:58.551110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d9ff4-04a2-4347-8680-3e365a1e3c62 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:58.583513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 810/1635] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:54:58.599828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-cc087531-c943-48c7-90cb-6e1cdc2d8d8a None None] MFA Rules not processed for user `1d465ffe97954b51bda034b2b8e0555c`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:58.601886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cc087531-c943-48c7-90cb-6e1cdc2d8d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:58.639705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d9ff4-04a2-4347-8680-3e365a1e3c62 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:58.652679 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d9ff4-04a2-4347-8680-3e365a1e3c62 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:58.666115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176cfaa-1a1a-496b-87f1-dc37c18813f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:58.667156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176cfaa-1a1a-496b-87f1-dc37c18813f0 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:58.668983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176cfaa-1a1a-496b-87f1-dc37c18813f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:58.671024 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176cfaa-1a1a-496b-87f1-dc37c18813f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:58.690263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176cfaa-1a1a-496b-87f1-dc37c18813f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:58.691687 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176cfaa-1a1a-496b-87f1-dc37c18813f0 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:58.706763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 826/1636] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:58.710407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 811/1637] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:54:58.733831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64b61-b336-4ffa-9714-ed92ab1aa1f5 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:58.734125 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64b61-b336-4ffa-9714-ed92ab1aa1f5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:58.734718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64b61-b336-4ffa-9714-ed92ab1aa1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:58.757898 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-c0f64b61-b336-4ffa-9714-ed92ab1aa1f5 None None] MFA Rules not processed for user `1d465ffe97954b51bda034b2b8e0555c`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:58.759431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c0f64b61-b336-4ffa-9714-ed92ab1aa1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:58.774954 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 827/1638] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:58.912252 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176cfaa-1a1a-496b-87f1-dc37c18813f0 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:58.928841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176cfaa-1a1a-496b-87f1-dc37c18813f0 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:58.943152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf98f-7749-4c0e-97d7-b82309376f57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:58.943825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf98f-7749-4c0e-97d7-b82309376f57 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:58.944111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf98f-7749-4c0e-97d7-b82309376f57 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:58.944385 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf98f-7749-4c0e-97d7-b82309376f57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:58.959668 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf98f-7749-4c0e-97d7-b82309376f57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:58.963019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf98f-7749-4c0e-97d7-b82309376f57 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:59.011073 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 812/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:54:59.217111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f64b61-b336-4ffa-9714-ed92ab1aa1f5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:59.366748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f64b61-b336-4ffa-9714-ed92ab1aa1f5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:59.389945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf98f-7749-4c0e-97d7-b82309376f57 service nova] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:59.390576 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:59.391545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:59.391989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:59.392446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] PATH_INFO: `/v3/users/ef833e9a07b1418f9b446dc72dd1f258` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:59.394697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef833e9a07b1418f9b446dc72dd1f258)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:59.396151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: WARNING py.warnings [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:54:59.396151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: warnings.warn(msg) Apr 06 12:54:59.396151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: Apr 06 12:54:59.398025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:59.414472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf98f-7749-4c0e-97d7-b82309376f57 service nova] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:59.426619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:59.428342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:59.428634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:59.428911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] PATH_INFO: `/v3/users/492be559e42c4080b276b30d3d7290b4` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:59.432114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] RBAC: Authorizing `identity:delete_user(user_id=492be559e42c4080b276b30d3d7290b4)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:54:59.442683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:54:59.547420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef833e9a07b1418f9b446dc72dd1f258'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:54:59.549380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef833e9a07b1418f9b446dc72dd1f258'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:54:59.550519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef833e9a07b1418f9b446dc72dd1f258'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:54:59.595088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef833e9a07b1418f9b446dc72dd1f258'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:54:59.596384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492be559e42c4080b276b30d3d7290b4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:54:59.597173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492be559e42c4080b276b30d3d7290b4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:54:59.598800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492be559e42c4080b276b30d3d7290b4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:54:59.620977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492be559e42c4080b276b30d3d7290b4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:54:59.624516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b9109f2a-b8be-4527-a7a0-0c24e73f9840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef833e9a07b1418f9b446dc72dd1f258'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:54:59.655079 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-96f2626a-4f44-433c-8f38-d13b11d3b90c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492be559e42c4080b276b30d3d7290b4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:54:59.656847 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 828/1640] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:54:59 2022] DELETE /identity/v3/users/ef833e9a07b1418f9b446dc72dd1f258 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:59.661479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade399-155f-4533-a603-4a378ccd4397 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:59.661875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade399-155f-4533-a603-4a378ccd4397 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:59.662219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade399-155f-4533-a603-4a378ccd4397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:59.698171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-26ade399-155f-4533-a603-4a378ccd4397 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:59.704843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-26ade399-155f-4533-a603-4a378ccd4397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:59.712826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 813/1641] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:54:59 2022] DELETE /identity/v3/users/492be559e42c4080b276b30d3d7290b4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:54:59.718527 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c62a2-68ed-4ec4-b22c-231f46fac5fd None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:59.718857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c62a2-68ed-4ec4-b22c-231f46fac5fd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:59.719102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c62a2-68ed-4ec4-b22c-231f46fac5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:59.766812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-303c62a2-68ed-4ec4-b22c-231f46fac5fd None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:59.769775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-303c62a2-68ed-4ec4-b22c-231f46fac5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:59.845321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 829/1642] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:54:59.845321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc941-d185-4962-896e-5a7fc67758c7 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:59.845321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc941-d185-4962-896e-5a7fc67758c7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:59.845321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc941-d185-4962-896e-5a7fc67758c7 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:59.855415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 830/1643] 10.222.0.23 () {54 vars in 912 bytes} [Wed Apr 6 12:54:59 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:54:59.856600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc941-d185-4962-896e-5a7fc67758c7 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:59.859605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-25acc941-d185-4962-896e-5a7fc67758c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:59.927845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 814/1644] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:54:59.932515 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c86e5-92b1-466e-8e03-01d5b232c3ec None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:59.933245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c86e5-92b1-466e-8e03-01d5b232c3ec None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:59.935259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c86e5-92b1-466e-8e03-01d5b232c3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:59.972525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc941-d185-4962-896e-5a7fc67758c7 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:54:59.976221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-338c86e5-92b1-466e-8e03-01d5b232c3ec None None] MFA Rules not processed for user `7bd327cdfe2c4f729252d86838aae638`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:54:59.977388 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3794eb5-3dac-4763-b5dc-4ff2dc7e5117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:54:59.977849 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-338c86e5-92b1-466e-8e03-01d5b232c3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:54:59.978432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794eb5-3dac-4763-b5dc-4ff2dc7e5117 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:54:59.978721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794eb5-3dac-4763-b5dc-4ff2dc7e5117 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:54:59.979050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794eb5-3dac-4763-b5dc-4ff2dc7e5117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:54:59.987528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 815/1645] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:54:59.988783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c86e5-92b1-466e-8e03-01d5b232c3ec None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:54:59.996723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3794eb5-3dac-4763-b5dc-4ff2dc7e5117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:00.001023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3794eb5-3dac-4763-b5dc-4ff2dc7e5117 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:00.006888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c86e5-92b1-466e-8e03-01d5b232c3ec None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:00.012805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df590b5-999e-4d75-8413-f36950ac298d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:00.013994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 831/1646] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:00.014939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3794eb5-3dac-4763-b5dc-4ff2dc7e5117 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:00.024797 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df590b5-999e-4d75-8413-f36950ac298d service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:00.025245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3794eb5-3dac-4763-b5dc-4ff2dc7e5117 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:00.030285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df590b5-999e-4d75-8413-f36950ac298d service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:00.031102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df590b5-999e-4d75-8413-f36950ac298d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:00.031629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8094c52-3f51-4582-9a14-3f74529326b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:00.032309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8094c52-3f51-4582-9a14-3f74529326b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:00.032774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8094c52-3f51-4582-9a14-3f74529326b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:00.033157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8094c52-3f51-4582-9a14-3f74529326b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:00.047709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8094c52-3f51-4582-9a14-3f74529326b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:00.051404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8094c52-3f51-4582-9a14-3f74529326b1 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:00.055827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df590b5-999e-4d75-8413-f36950ac298d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:00.057924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df590b5-999e-4d75-8413-f36950ac298d service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:00.074053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 816/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:00.074894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 832/1648] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:01.266328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df590b5-999e-4d75-8413-f36950ac298d service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:01.268394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1df590b5-999e-4d75-8413-f36950ac298d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:01.291680 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df590b5-999e-4d75-8413-f36950ac298d service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:01.316643 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:01.317542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:01.327792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:01.328489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] PATH_INFO: `/v3/projects/85f42e9cb8e7446fb4b8f9a9d823cbcf` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:01.330680 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f42e9cb8e7446fb4b8f9a9d823cbcf)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:01.333288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: WARNING py.warnings [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 06 12:55:01.333288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: warnings.warn(msg) Apr 06 12:55:01.333288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: Apr 06 12:55:01.342908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:01.523905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f42e9cb8e7446fb4b8f9a9d823cbcf', 'request_id': 'req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:01.532556 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8094c52-3f51-4582-9a14-3f74529326b1 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:01.533991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a8094c52-3f51-4582-9a14-3f74529326b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:01.546226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f42e9cb8e7446fb4b8f9a9d823cbcf', 'request_id': 'req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:01.559038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f42e9cb8e7446fb4b8f9a9d823cbcf', 'request_id': 'req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:01.576775 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8094c52-3f51-4582-9a14-3f74529326b1 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:01.640379 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] The token cache is being invalidate because project 85f42e9cb8e7446fb4b8f9a9d823cbcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:01.640684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:01.641384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:01.643290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 817/1649] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:01 2022] DELETE /identity/v3/projects/85f42e9cb8e7446fb4b8f9a9d823cbcf => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:01.651222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:01.660999 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:01.851545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:01.853731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:01.854127 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:01.854291 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] PATH_INFO: `/v3/users/d1ba82d333a54abaa2d025c0f6dffce7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:01.858701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ba82d333a54abaa2d025c0f6dffce7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:01.861489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:01.869529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bafecf1-08c6-4ebe-b57c-161b5af60ea5 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:01.887261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:01.889103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:01.889615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:01.890860 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] PATH_INFO: `/v3/users/4a66ebeb62b9460c92b4fbf534b68449` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:01.892570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a66ebeb62b9460c92b4fbf534b68449)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:01.906457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:01.944749 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ba82d333a54abaa2d025c0f6dffce7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:01.945549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ba82d333a54abaa2d025c0f6dffce7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:01.946300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ba82d333a54abaa2d025c0f6dffce7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:01.975707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ba82d333a54abaa2d025c0f6dffce7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:01.989598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-491401c5-b755-4bef-8286-c3a71b50c23f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ba82d333a54abaa2d025c0f6dffce7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.009456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a66ebeb62b9460c92b4fbf534b68449'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.010640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a66ebeb62b9460c92b4fbf534b68449'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.011410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a66ebeb62b9460c92b4fbf534b68449'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.021142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 833/1650] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:01 2022] DELETE /identity/v3/users/d1ba82d333a54abaa2d025c0f6dffce7 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:55:02.022318 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b084f73-4d71-41b0-a06b-43422459656c None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:02.022598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b084f73-4d71-41b0-a06b-43422459656c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:02.022875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b084f73-4d71-41b0-a06b-43422459656c None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:02.023505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a66ebeb62b9460c92b4fbf534b68449'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.024365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 834/1651] 10.222.0.23 () {54 vars in 960 bytes} [Wed Apr 6 12:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:55:02.050269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b084f73-4d71-41b0-a06b-43422459656c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:02.055119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0b084f73-4d71-41b0-a06b-43422459656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:02.071565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9439e564-9b21-4831-b7fb-31d0a27323e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a66ebeb62b9460c92b4fbf534b68449'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.103473 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 818/1652] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:01 2022] DELETE /identity/v3/users/4a66ebeb62b9460c92b4fbf534b68449 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:02.111291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e5547-d8f6-423a-8470-8a20636b54f0 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:02.111613 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e5547-d8f6-423a-8470-8a20636b54f0 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:02.111899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e5547-d8f6-423a-8470-8a20636b54f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:02.135571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-1f2e5547-d8f6-423a-8470-8a20636b54f0 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:02.136811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1f2e5547-d8f6-423a-8470-8a20636b54f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:02.203071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b084f73-4d71-41b0-a06b-43422459656c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:02.307110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 819/1653] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:02.310596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3d98-4b25-46b4-abe7-dd5978997b62 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:02.311223 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3d98-4b25-46b4-abe7-dd5978997b62 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:02.312897 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3d98-4b25-46b4-abe7-dd5978997b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:02.335659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:02.336905 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:02.339943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:02.340533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] PATH_INFO: `/v3/projects/4de1d2967b8744e4bccc57d7bccd32ac` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:02.343608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de1d2967b8744e4bccc57d7bccd32ac)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:02.348040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:02.357609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-75fe3d98-4b25-46b4-abe7-dd5978997b62 None None] MFA Rules not processed for user `221dab3ebc4f4c68b253729391e9c503`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:02.359241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-75fe3d98-4b25-46b4-abe7-dd5978997b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:02.504168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de1d2967b8744e4bccc57d7bccd32ac', 'request_id': 'req-e279ff3b-165a-495d-b1ea-997ca72ade5a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.521281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de1d2967b8744e4bccc57d7bccd32ac', 'request_id': 'req-e279ff3b-165a-495d-b1ea-997ca72ade5a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.546606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de1d2967b8744e4bccc57d7bccd32ac', 'request_id': 'req-e279ff3b-165a-495d-b1ea-997ca72ade5a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.585042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] The token cache is being invalidate because project 4de1d2967b8744e4bccc57d7bccd32ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:02.585373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.589065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:02.592352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 835/1654] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:02 2022] DELETE /identity/v3/projects/4de1d2967b8744e4bccc57d7bccd32ac => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:02.594220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 820/1655] 10.222.0.23 () {58 vars in 1057 bytes} [Wed Apr 6 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:02.595868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:02.598408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cceeb6-19d6-4c8d-8248-57479132fb78 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:02.604476 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:02.605321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cceeb6-19d6-4c8d-8248-57479132fb78 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:02.606609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cceeb6-19d6-4c8d-8248-57479132fb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:02.668128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-63cceeb6-19d6-4c8d-8248-57479132fb78 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:02.673003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-63cceeb6-19d6-4c8d-8248-57479132fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:02.780165 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279ff3b-165a-495d-b1ea-997ca72ade5a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:02.790208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b8290-d0a6-480d-b588-7e1e01ee77b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:02.792910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b8290-d0a6-480d-b588-7e1e01ee77b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:02.793339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b8290-d0a6-480d-b588-7e1e01ee77b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:02.793974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b8290-d0a6-480d-b588-7e1e01ee77b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:02.801737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a52b8290-d0a6-480d-b588-7e1e01ee77b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:02.828830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 821/1656] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:02.831748 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cceeb6-19d6-4c8d-8248-57479132fb78 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:02.833248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-63cceeb6-19d6-4c8d-8248-57479132fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:02.984374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b8290-d0a6-480d-b588-7e1e01ee77b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:02.987168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b8290-d0a6-480d-b588-7e1e01ee77b8 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:03.014342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 836/1657] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:03.017742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f68e4-b7e2-42de-a7c6-8c20710649e2 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.020735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f68e4-b7e2-42de-a7c6-8c20710649e2 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.021473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f68e4-b7e2-42de-a7c6-8c20710649e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.024048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cceeb6-19d6-4c8d-8248-57479132fb78 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:03.055505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94909-ebb8-42ec-9c83-787e2592f836 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221dab3ebc4f4c68b253729391e9c503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:03.056182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94909-ebb8-42ec-9c83-787e2592f836 service placement] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.056504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94909-ebb8-42ec-9c83-787e2592f836 service placement] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.059493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e94909-ebb8-42ec-9c83-787e2592f836 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.064895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-37e94909-ebb8-42ec-9c83-787e2592f836 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:03.081022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-7b3f68e4-b7e2-42de-a7c6-8c20710649e2 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:03.082374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7b3f68e4-b7e2-42de-a7c6-8c20710649e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:03.090764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94909-ebb8-42ec-9c83-787e2592f836 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:03.095018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e94909-ebb8-42ec-9c83-787e2592f836 service placement] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:03.101494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 837/1658] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:03.105677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f68e4-b7e2-42de-a7c6-8c20710649e2 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:03.124911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f68e4-b7e2-42de-a7c6-8c20710649e2 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:03.125885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 822/1659] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:03.132455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b60b-c91d-42bc-b897-8b6cc0a1a094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:03.133136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b60b-c91d-42bc-b897-8b6cc0a1a094 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.133422 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b60b-c91d-42bc-b897-8b6cc0a1a094 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.133969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614b60b-c91d-42bc-b897-8b6cc0a1a094 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.134716 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614b60b-c91d-42bc-b897-8b6cc0a1a094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:03.135027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614b60b-c91d-42bc-b897-8b6cc0a1a094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:03.136704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614b60b-c91d-42bc-b897-8b6cc0a1a094 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:03.160168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 838/1660] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:03.164263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94909-ebb8-42ec-9c83-787e2592f836 service placement] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:03.177975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e94909-ebb8-42ec-9c83-787e2592f836 service placement] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:03.219617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa280-c246-43ad-8b3c-2ec15ba1ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:03.220350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa280-c246-43ad-8b3c-2ec15ba1ac70 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.220682 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa280-c246-43ad-8b3c-2ec15ba1ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.220916 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1aa280-c246-43ad-8b3c-2ec15ba1ac70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.221636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aa280-c246-43ad-8b3c-2ec15ba1ac70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:03.223589 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1aa280-c246-43ad-8b3c-2ec15ba1ac70 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:03.280400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 823/1661] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:03 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:03.284412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b60b-c91d-42bc-b897-8b6cc0a1a094 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:03.299780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614b60b-c91d-42bc-b897-8b6cc0a1a094 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:03.443256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfde1c9-1226-417b-b31d-2b6ac69ff059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:03.444347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfde1c9-1226-417b-b31d-2b6ac69ff059 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.444347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfde1c9-1226-417b-b31d-2b6ac69ff059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.444611 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfde1c9-1226-417b-b31d-2b6ac69ff059 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.445292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfde1c9-1226-417b-b31d-2b6ac69ff059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:03.447745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfde1c9-1226-417b-b31d-2b6ac69ff059 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:03.501823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa280-c246-43ad-8b3c-2ec15ba1ac70 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:03.504430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9e1aa280-c246-43ad-8b3c-2ec15ba1ac70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:03.506467 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 839/1662] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:03 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:03.511653 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfde1c9-1226-417b-b31d-2b6ac69ff059 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:03.519769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1aa280-c246-43ad-8b3c-2ec15ba1ac70 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:03.544004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfde1c9-1226-417b-b31d-2b6ac69ff059 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:03.547404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:03.551483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.556237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.558021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] PATH_INFO: `/v3/projects/f0f9dd9773dc44778f9c8a3af8fd234a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.565761 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f9dd9773dc44778f9c8a3af8fd234a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:03.571150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e67a0-b1a6-40a6-90bb-f24ce18db6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:03.571755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:03.571832 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e67a0-b1a6-40a6-90bb-f24ce18db6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.572127 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e67a0-b1a6-40a6-90bb-f24ce18db6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.573019 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e67a0-b1a6-40a6-90bb-f24ce18db6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.579352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e67a0-b1a6-40a6-90bb-f24ce18db6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:03.587494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e67a0-b1a6-40a6-90bb-f24ce18db6a1 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:03.624181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 840/1663] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:03.632236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e67a0-b1a6-40a6-90bb-f24ce18db6a1 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:03.662890 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e67a0-b1a6-40a6-90bb-f24ce18db6a1 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:03.692600 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f9dd9773dc44778f9c8a3af8fd234a', 'request_id': 'req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:03.709133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f9dd9773dc44778f9c8a3af8fd234a', 'request_id': 'req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:03.722421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f9dd9773dc44778f9c8a3af8fd234a', 'request_id': 'req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:03.740955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] The token cache is being invalidate because project f0f9dd9773dc44778f9c8a3af8fd234a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:03.741531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:03.743262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ca8ae3e4-552a-4f71-ad8d-5558bad4a152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:03.745806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 824/1664] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:03 2022] DELETE /identity/v3/projects/f0f9dd9773dc44778f9c8a3af8fd234a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:03.751812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0711-9803-4984-9f69-d2d989ebfaa5 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.752392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0711-9803-4984-9f69-d2d989ebfaa5 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.752814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0711-9803-4984-9f69-d2d989ebfaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.782124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c89b0711-9803-4984-9f69-d2d989ebfaa5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:03.784035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c89b0711-9803-4984-9f69-d2d989ebfaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:03.813542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6a958-6be6-4ffd-9e03-8f3cd2e61f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:03.814316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6a958-6be6-4ffd-9e03-8f3cd2e61f30 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.815227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6a958-6be6-4ffd-9e03-8f3cd2e61f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.815677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6a958-6be6-4ffd-9e03-8f3cd2e61f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.826176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6a958-6be6-4ffd-9e03-8f3cd2e61f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:03.828487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6a958-6be6-4ffd-9e03-8f3cd2e61f30 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:03.885143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 841/1665] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:03.894689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6a958-6be6-4ffd-9e03-8f3cd2e61f30 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:03.902978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-afa6a958-6be6-4ffd-9e03-8f3cd2e61f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:03.919832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 825/1666] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:03.930207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69f747-0da1-4a32-b78a-35513d1ca0e4 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.930487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69f747-0da1-4a32-b78a-35513d1ca0e4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.930773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69f747-0da1-4a32-b78a-35513d1ca0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.933393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6a958-6be6-4ffd-9e03-8f3cd2e61f30 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:03.942743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce576f90-494a-4520-8b74-56fe2b1b023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:03.944026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce576f90-494a-4520-8b74-56fe2b1b023a admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:03.944448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce576f90-494a-4520-8b74-56fe2b1b023a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:03.944860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce576f90-494a-4520-8b74-56fe2b1b023a admin admin] PATH_INFO: `/v3/projects/fd76c21582644d5ab809d21ae50a7c8f/users/db97149b58904bf2911577f3e7218dc3/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:03.978702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce576f90-494a-4520-8b74-56fe2b1b023a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd76c21582644d5ab809d21ae50a7c8f, user_id=db97149b58904bf2911577f3e7218dc3, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:03.988785 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce576f90-494a-4520-8b74-56fe2b1b023a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.000824 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-bd69f747-0da1-4a32-b78a-35513d1ca0e4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:04.011291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bd69f747-0da1-4a32-b78a-35513d1ca0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:04.033544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 842/1667] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:03 2022] PUT /identity/v3/projects/fd76c21582644d5ab809d21ae50a7c8f/users/db97149b58904bf2911577f3e7218dc3/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:04.035676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab478a-27d2-4b94-b803-dee4ba659627 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.036204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab478a-27d2-4b94-b803-dee4ba659627 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.036800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab478a-27d2-4b94-b803-dee4ba659627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.083117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-7bab478a-27d2-4b94-b803-dee4ba659627 None None] MFA Rules not processed for user `db97149b58904bf2911577f3e7218dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:04.084417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7bab478a-27d2-4b94-b803-dee4ba659627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:04.194791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 826/1668] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:04.197526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69f747-0da1-4a32-b78a-35513d1ca0e4 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:04.204347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bd69f747-0da1-4a32-b78a-35513d1ca0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:04.230344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 843/1669] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:04.231591 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab478a-27d2-4b94-b803-dee4ba659627 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:04.246066 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69f747-0da1-4a32-b78a-35513d1ca0e4 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:04.247106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab478a-27d2-4b94-b803-dee4ba659627 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:04.258887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574862db-ba5d-45d7-a6fd-78730b66267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:04.259843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574862db-ba5d-45d7-a6fd-78730b66267d admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.260266 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574862db-ba5d-45d7-a6fd-78730b66267d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.260780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574862db-ba5d-45d7-a6fd-78730b66267d admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.262177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:04.263911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.264192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.264708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] PATH_INFO: `/v3/projects/d182b02f06234cd1b7be27af5000f785` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.266026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574862db-ba5d-45d7-a6fd-78730b66267d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:04.266299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574862db-ba5d-45d7-a6fd-78730b66267d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:04.269459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574862db-ba5d-45d7-a6fd-78730b66267d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.271482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d182b02f06234cd1b7be27af5000f785)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:04.273623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.288910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 844/1670] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:04.289910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574862db-ba5d-45d7-a6fd-78730b66267d admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:04.304161 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574862db-ba5d-45d7-a6fd-78730b66267d admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:04.312095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d59a0-e3bf-4268-b088-a1cf7aba276b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:04.312946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d59a0-e3bf-4268-b088-a1cf7aba276b admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.313226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d59a0-e3bf-4268-b088-a1cf7aba276b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.313551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d59a0-e3bf-4268-b088-a1cf7aba276b admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.314272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d59a0-e3bf-4268-b088-a1cf7aba276b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:04.316692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d59a0-e3bf-4268-b088-a1cf7aba276b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.367006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd182b02f06234cd1b7be27af5000f785', 'request_id': 'req-5038cd6e-77fc-461d-940b-593566e4e8e6'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:04.384835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 845/1671] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:04 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:04.385763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d59a0-e3bf-4268-b088-a1cf7aba276b admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:04.388927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd182b02f06234cd1b7be27af5000f785', 'request_id': 'req-5038cd6e-77fc-461d-940b-593566e4e8e6'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:04.418253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd182b02f06234cd1b7be27af5000f785', 'request_id': 'req-5038cd6e-77fc-461d-940b-593566e4e8e6'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:04.449353 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] The token cache is being invalidate because project d182b02f06234cd1b7be27af5000f785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:04.451637 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:04.453283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:04.457317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 827/1672] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:04 2022] DELETE /identity/v3/projects/d182b02f06234cd1b7be27af5000f785 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:04.460648 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:04.464620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:04.540549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d59a0-e3bf-4268-b088-a1cf7aba276b admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:04.550274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f0d9-8522-4540-a5f7-8142a3fa5301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:04.551061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f0d9-8522-4540-a5f7-8142a3fa5301 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.551348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f0d9-8522-4540-a5f7-8142a3fa5301 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.551705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f0d9-8522-4540-a5f7-8142a3fa5301 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.552744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615f0d9-8522-4540-a5f7-8142a3fa5301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:04.557484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615f0d9-8522-4540-a5f7-8142a3fa5301 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.607317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 846/1673] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:04 2022] POST /identity/v3/projects => generated 363 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:04.609723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e99ae-9a15-4fa1-97c7-deba17bd617b None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.610067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e99ae-9a15-4fa1-97c7-deba17bd617b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.610351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e99ae-9a15-4fa1-97c7-deba17bd617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.637392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038cd6e-77fc-461d-940b-593566e4e8e6 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:04.639475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-088e99ae-9a15-4fa1-97c7-deba17bd617b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:04.640855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-088e99ae-9a15-4fa1-97c7-deba17bd617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:04.760492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 847/1674] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:04.761621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dae849-bda5-4337-ae34-5dada80a230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:04.761852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e99ae-9a15-4fa1-97c7-deba17bd617b None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:04.765029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-088e99ae-9a15-4fa1-97c7-deba17bd617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:04.766588 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dae849-bda5-4337-ae34-5dada80a230f admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.767694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dae849-bda5-4337-ae34-5dada80a230f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.768151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dae849-bda5-4337-ae34-5dada80a230f admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.769106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dae849-bda5-4337-ae34-5dada80a230f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:04.772223 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dae849-bda5-4337-ae34-5dada80a230f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.790785 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e99ae-9a15-4fa1-97c7-deba17bd617b None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:04.805698 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe9a45-d0b6-456e-bafd-b58675e63670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:04.806430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe9a45-d0b6-456e-bafd-b58675e63670 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.806711 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe9a45-d0b6-456e-bafd-b58675e63670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.806987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe9a45-d0b6-456e-bafd-b58675e63670 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.807735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe9a45-d0b6-456e-bafd-b58675e63670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:04.809696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe9a45-d0b6-456e-bafd-b58675e63670 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.818658 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 828/1675] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:04 2022] POST /identity/v3/users => generated 288 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:04.819969 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2d33-928e-4760-b27d-17dfad146033 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.825074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2d33-928e-4760-b27d-17dfad146033 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.825664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e2d33-928e-4760-b27d-17dfad146033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.837112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 848/1676] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:04 2022] POST /identity/v3/users => generated 282 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:04.838040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe9a45-d0b6-456e-bafd-b58675e63670 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:04.850572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe9a45-d0b6-456e-bafd-b58675e63670 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:04.855816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59341980-6a6b-4e6f-a388-f31bfe1a3b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:04.856526 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341980-6a6b-4e6f-a388-f31bfe1a3b0a admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.857420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341980-6a6b-4e6f-a388-f31bfe1a3b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.857746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341980-6a6b-4e6f-a388-f31bfe1a3b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.858534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59341980-6a6b-4e6f-a388-f31bfe1a3b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:04.860237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59341980-6a6b-4e6f-a388-f31bfe1a3b0a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.868779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-9a3e2d33-928e-4760-b27d-17dfad146033 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:04.870110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9a3e2d33-928e-4760-b27d-17dfad146033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:04.875309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 849/1677] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:04.875309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59341980-6a6b-4e6f-a388-f31bfe1a3b0a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:04.884383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59341980-6a6b-4e6f-a388-f31bfe1a3b0a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:04.894414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cdaa1-5993-4410-a61d-28b9aecfccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:04.894650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 829/1678] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:04.895622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e2d33-928e-4760-b27d-17dfad146033 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:04.900006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cdaa1-5993-4410-a61d-28b9aecfccfe admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.900006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cdaa1-5993-4410-a61d-28b9aecfccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.900006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cdaa1-5993-4410-a61d-28b9aecfccfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.900006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cdaa1-5993-4410-a61d-28b9aecfccfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:04.901935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cdaa1-5993-4410-a61d-28b9aecfccfe admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.915432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 850/1679] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:04.916533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cdaa1-5993-4410-a61d-28b9aecfccfe admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:04.923197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e2d33-928e-4760-b27d-17dfad146033 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:04.939002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fb073-33f7-4e80-b501-abfb586fb024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:04.939209 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cdaa1-5993-4410-a61d-28b9aecfccfe admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:04.939963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fb073-33f7-4e80-b501-abfb586fb024 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.940227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fb073-33f7-4e80-b501-abfb586fb024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.940508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fb073-33f7-4e80-b501-abfb586fb024 admin admin] PATH_INFO: `/v3/projects/589e4844a96740749c9c2013f8b54d52/users/bfd8f2e6d80a40288a1f0aba1898b721/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.954017 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360e229-fdaa-4bae-9652-255f981d5448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:04.955583 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360e229-fdaa-4bae-9652-255f981d5448 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:04.955583 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360e229-fdaa-4bae-9652-255f981d5448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:04.955818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360e229-fdaa-4bae-9652-255f981d5448 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:04.956489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360e229-fdaa-4bae-9652-255f981d5448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:04.958129 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360e229-fdaa-4bae-9652-255f981d5448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:04.961125 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360e229-fdaa-4bae-9652-255f981d5448 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.975978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fb073-33f7-4e80-b501-abfb586fb024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589e4844a96740749c9c2013f8b54d52, user_id=bfd8f2e6d80a40288a1f0aba1898b721, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:04.978695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fb073-33f7-4e80-b501-abfb586fb024 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:04.992028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 851/1680] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:04.999963 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360e229-fdaa-4bae-9652-255f981d5448 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:05.006747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 830/1681] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:04 2022] PUT /identity/v3/projects/589e4844a96740749c9c2013f8b54d52/users/bfd8f2e6d80a40288a1f0aba1898b721/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:05.007656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fb073-33f7-4e80-b501-abfb586fb024 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:05.036385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360e229-fdaa-4bae-9652-255f981d5448 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:05.179016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fb073-33f7-4e80-b501-abfb586fb024 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:05.188783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161cde1-6b69-40ff-91a0-a932beeef38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:05.189469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161cde1-6b69-40ff-91a0-a932beeef38a admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:05.189784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161cde1-6b69-40ff-91a0-a932beeef38a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:05.190062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161cde1-6b69-40ff-91a0-a932beeef38a admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:05.193227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161cde1-6b69-40ff-91a0-a932beeef38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:05.201109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161cde1-6b69-40ff-91a0-a932beeef38a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:05.218403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d8ded-0ba3-4dd4-90b1-2e5f0fc5aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:05.218626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8ded-0ba3-4dd4-90b1-2e5f0fc5aa88 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:05.218895 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8ded-0ba3-4dd4-90b1-2e5f0fc5aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:05.219173 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8ded-0ba3-4dd4-90b1-2e5f0fc5aa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:05.220269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d8ded-0ba3-4dd4-90b1-2e5f0fc5aa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:05.221557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d8ded-0ba3-4dd4-90b1-2e5f0fc5aa88 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:05.257510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 831/1682] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:05 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:05.260902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161cde1-6b69-40ff-91a0-a932beeef38a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:05.261549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 852/1683] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:05.265884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d8ded-0ba3-4dd4-90b1-2e5f0fc5aa88 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:05.292880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d8ded-0ba3-4dd4-90b1-2e5f0fc5aa88 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:05.437488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161cde1-6b69-40ff-91a0-a932beeef38a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:05.445250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb5a33-898f-4da6-b9ed-70fe855f7bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:05.446405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb5a33-898f-4da6-b9ed-70fe855f7bbf admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:05.446832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb5a33-898f-4da6-b9ed-70fe855f7bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:05.447245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb5a33-898f-4da6-b9ed-70fe855f7bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:05.448445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb5a33-898f-4da6-b9ed-70fe855f7bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:05.451221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb5a33-898f-4da6-b9ed-70fe855f7bbf admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:05.469213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6749ce7-85bf-40a2-b656-16861455ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:05.472917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6749ce7-85bf-40a2-b656-16861455ef20 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:05.474049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6749ce7-85bf-40a2-b656-16861455ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:05.475030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6749ce7-85bf-40a2-b656-16861455ef20 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:05.476094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6749ce7-85bf-40a2-b656-16861455ef20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:05.479830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6749ce7-85bf-40a2-b656-16861455ef20 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:05.493859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 832/1684] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:05.495328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb5a33-898f-4da6-b9ed-70fe855f7bbf admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:05.514798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb5a33-898f-4da6-b9ed-70fe855f7bbf admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:05.525332 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aeb48-8687-4997-88d2-fc464841d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:05.527044 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aeb48-8687-4997-88d2-fc464841d1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:05.527628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aeb48-8687-4997-88d2-fc464841d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:05.528006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aeb48-8687-4997-88d2-fc464841d1d9 admin admin] PATH_INFO: `/v3/projects/de12ed9ce92e4fe7a16df22b27b3a465/users/7b5407235e334ddabe02508bc29734dc/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:05.531169 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 853/1685] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:05 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:05.532213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6749ce7-85bf-40a2-b656-16861455ef20 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:05.552241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aeb48-8687-4997-88d2-fc464841d1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de12ed9ce92e4fe7a16df22b27b3a465, user_id=7b5407235e334ddabe02508bc29734dc, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:05.557263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6749ce7-85bf-40a2-b656-16861455ef20 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:05.559901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aeb48-8687-4997-88d2-fc464841d1d9 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:05.575394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94749167-4d44-4a4e-831c-fe0a4c00e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:05.576966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94749167-4d44-4a4e-831c-fe0a4c00e063 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:05.577328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94749167-4d44-4a4e-831c-fe0a4c00e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:05.577627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94749167-4d44-4a4e-831c-fe0a4c00e063 admin admin] PATH_INFO: `/v3/projects/589e4844a96740749c9c2013f8b54d52/users/bfd8f2e6d80a40288a1f0aba1898b721/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:05.582083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94749167-4d44-4a4e-831c-fe0a4c00e063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589e4844a96740749c9c2013f8b54d52, user_id=bfd8f2e6d80a40288a1f0aba1898b721, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:05.584811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94749167-4d44-4a4e-831c-fe0a4c00e063 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:05.596037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 833/1686] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:05 2022] PUT /identity/v3/projects/de12ed9ce92e4fe7a16df22b27b3a465/users/7b5407235e334ddabe02508bc29734dc/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:05.597688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aeb48-8687-4997-88d2-fc464841d1d9 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:05.615516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 854/1687] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:05 2022] PUT /identity/v3/projects/589e4844a96740749c9c2013f8b54d52/users/bfd8f2e6d80a40288a1f0aba1898b721/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:05.617933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77067a3-7e2a-459a-94b4-558d7c845d2c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:05.618232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77067a3-7e2a-459a-94b4-558d7c845d2c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:05.618893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77067a3-7e2a-459a-94b4-558d7c845d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:05.685284 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-f77067a3-7e2a-459a-94b4-558d7c845d2c None None] MFA Rules not processed for user `7b5407235e334ddabe02508bc29734dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:05.688504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f77067a3-7e2a-459a-94b4-558d7c845d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:05.750488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aeb48-8687-4997-88d2-fc464841d1d9 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:05.825143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 855/1688] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:05.829438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95e0a5-abdd-4fd3-a358-af94ef0584ed None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:05.830423 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95e0a5-abdd-4fd3-a358-af94ef0584ed None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:05.831270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95e0a5-abdd-4fd3-a358-af94ef0584ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:05.904786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e4ce7-1345-453b-b2c8-da879217c5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:05.905537 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e4ce7-1345-453b-b2c8-da879217c5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:05.905856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e4ce7-1345-453b-b2c8-da879217c5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:05.906164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e4ce7-1345-453b-b2c8-da879217c5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:05.906907 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e4ce7-1345-453b-b2c8-da879217c5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:05.910283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-ef95e0a5-abdd-4fd3-a358-af94ef0584ed None None] MFA Rules not processed for user `bfd8f2e6d80a40288a1f0aba1898b721`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:05.910957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e4ce7-1345-453b-b2c8-da879217c5b4 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:05.913677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-ef95e0a5-abdd-4fd3-a358-af94ef0584ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:05.953618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 834/1689] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:05.954351 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e4ce7-1345-453b-b2c8-da879217c5b4 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:05.987893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e4ce7-1345-453b-b2c8-da879217c5b4 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:06.007220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959df0f-fe2c-4383-8b41-213ccaeffff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:06.007930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959df0f-fe2c-4383-8b41-213ccaeffff6 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:06.008214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959df0f-fe2c-4383-8b41-213ccaeffff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:06.008496 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959df0f-fe2c-4383-8b41-213ccaeffff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:06.009302 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959df0f-fe2c-4383-8b41-213ccaeffff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:06.011362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959df0f-fe2c-4383-8b41-213ccaeffff6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:06.080178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 856/1690] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:06.084639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95e0a5-abdd-4fd3-a358-af94ef0584ed None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:06.094772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 835/1691] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:05 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:06.099003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959df0f-fe2c-4383-8b41-213ccaeffff6 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:06.102900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6959df0f-fe2c-4383-8b41-213ccaeffff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:06.119070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95e0a5-abdd-4fd3-a358-af94ef0584ed None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:06.217519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b9ece-65a0-4015-bf37-50fb5044790d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:06.218506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b9ece-65a0-4015-bf37-50fb5044790d admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:06.219072 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b9ece-65a0-4015-bf37-50fb5044790d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:06.219492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b9ece-65a0-4015-bf37-50fb5044790d admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:06.220509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b9ece-65a0-4015-bf37-50fb5044790d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:06.220701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959df0f-fe2c-4383-8b41-213ccaeffff6 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:06.222505 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b9ece-65a0-4015-bf37-50fb5044790d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:06.228654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3001aff-d51b-4a23-bad8-181dff09d866 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:06.229331 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3001aff-d51b-4a23-bad8-181dff09d866 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:06.229959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3001aff-d51b-4a23-bad8-181dff09d866 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:06.230454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3001aff-d51b-4a23-bad8-181dff09d866 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:06.244362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 857/1692] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:06.244362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b9ece-65a0-4015-bf37-50fb5044790d admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:06.259458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b9ece-65a0-4015-bf37-50fb5044790d admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:06.265094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0e27b-5820-472d-8cdf-a981ade24e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:06.265790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e27b-5820-472d-8cdf-a981ade24e6f admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:06.266221 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e27b-5820-472d-8cdf-a981ade24e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:06.267707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0e27b-5820-472d-8cdf-a981ade24e6f admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:06.267707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0e27b-5820-472d-8cdf-a981ade24e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:06.270680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0e27b-5820-472d-8cdf-a981ade24e6f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:06.312596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 858/1693] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:06 2022] POST /identity/v3/users => generated 289 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:06.314316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0e27b-5820-472d-8cdf-a981ade24e6f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:06.366509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0e27b-5820-472d-8cdf-a981ade24e6f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:06.386163 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a29538-671c-4c43-9942-201d826c7e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:06.387128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a29538-671c-4c43-9942-201d826c7e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:06.387412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a29538-671c-4c43-9942-201d826c7e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:06.388212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a29538-671c-4c43-9942-201d826c7e8b admin admin] PATH_INFO: `/v3/projects/02901fddd19340588cdf37df18144bbf/users/16182baab9ea45069a60d011788a4b7d/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:06.425189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a29538-671c-4c43-9942-201d826c7e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02901fddd19340588cdf37df18144bbf, user_id=16182baab9ea45069a60d011788a4b7d, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:06.427937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a29538-671c-4c43-9942-201d826c7e8b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:06.436872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3001aff-d51b-4a23-bad8-181dff09d866 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:06.439581 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3001aff-d51b-4a23-bad8-181dff09d866 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:06.463095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 859/1694] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:06 2022] PUT /identity/v3/projects/02901fddd19340588cdf37df18144bbf/users/16182baab9ea45069a60d011788a4b7d/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:06.464892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a29538-671c-4c43-9942-201d826c7e8b admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:06.474541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 836/1695] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:06.474541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c5fed-38c8-468e-b03a-78653238e673 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:06.474541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c5fed-38c8-468e-b03a-78653238e673 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:06.474541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c5fed-38c8-468e-b03a-78653238e673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:06.500634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-6a3c5fed-38c8-468e-b03a-78653238e673 None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:06.502910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6a3c5fed-38c8-468e-b03a-78653238e673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:06.585064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 837/1696] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:06.601975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a29538-671c-4c43-9942-201d826c7e8b admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:06.612643 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3f6a1-48a3-4580-8897-abc77a58ca99 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:06.613662 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3f6a1-48a3-4580-8897-abc77a58ca99 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:06.616051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3f6a1-48a3-4580-8897-abc77a58ca99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:06.627543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280abc9d-8c48-466c-8ca1-0328d896aef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:06.628244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280abc9d-8c48-466c-8ca1-0328d896aef4 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:06.628528 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280abc9d-8c48-466c-8ca1-0328d896aef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:06.630948 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280abc9d-8c48-466c-8ca1-0328d896aef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:06.632037 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280abc9d-8c48-466c-8ca1-0328d896aef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:06.639860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280abc9d-8c48-466c-8ca1-0328d896aef4 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:06.650339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-02d3f6a1-48a3-4580-8897-abc77a58ca99 None None] MFA Rules not processed for user `16182baab9ea45069a60d011788a4b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:06.651880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-02d3f6a1-48a3-4580-8897-abc77a58ca99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:06.674675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 860/1697] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:06.677431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280abc9d-8c48-466c-8ca1-0328d896aef4 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:06.750344 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 838/1698] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:06.751443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3f6a1-48a3-4580-8897-abc77a58ca99 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:06.755186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280abc9d-8c48-466c-8ca1-0328d896aef4 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:06.785439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad020b-7273-46e9-aa63-9a544647da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:06.786496 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad020b-7273-46e9-aa63-9a544647da45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:06.786818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad020b-7273-46e9-aa63-9a544647da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:06.787154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad020b-7273-46e9-aa63-9a544647da45 admin admin] PATH_INFO: `/v3/projects/b0a37819a33c4edea8de80cc0f30efc0/users/45b86f6596b94408a2be54c2fdd436e9/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:06.841837 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad020b-7273-46e9-aa63-9a544647da45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a37819a33c4edea8de80cc0f30efc0, user_id=45b86f6596b94408a2be54c2fdd436e9, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:06.851260 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad020b-7273-46e9-aa63-9a544647da45 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:06.878783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3f6a1-48a3-4580-8897-abc77a58ca99 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:06.885665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 861/1699] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:06 2022] PUT /identity/v3/projects/b0a37819a33c4edea8de80cc0f30efc0/users/45b86f6596b94408a2be54c2fdd436e9/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:06.885665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad020b-7273-46e9-aa63-9a544647da45 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:07.024862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4527-8f6c-4a4a-9ff9-aa7a4a6fbe54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:07.025723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4527-8f6c-4a4a-9ff9-aa7a4a6fbe54 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:07.026071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4527-8f6c-4a4a-9ff9-aa7a4a6fbe54 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:07.026414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc4527-8f6c-4a4a-9ff9-aa7a4a6fbe54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:07.031789 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e4dc4527-8f6c-4a4a-9ff9-aa7a4a6fbe54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:07.107939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad020b-7273-46e9-aa63-9a544647da45 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:07.124220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96eec-2330-4d49-99c5-cd55ef90262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:07.125377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96eec-2330-4d49-99c5-cd55ef90262c admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:07.125920 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96eec-2330-4d49-99c5-cd55ef90262c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:07.126675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96eec-2330-4d49-99c5-cd55ef90262c admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:07.128343 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f96eec-2330-4d49-99c5-cd55ef90262c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:07.135180 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f96eec-2330-4d49-99c5-cd55ef90262c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:07.152081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc4527-8f6c-4a4a-9ff9-aa7a4a6fbe54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:07.154810 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc4527-8f6c-4a4a-9ff9-aa7a4a6fbe54 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:07.178403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 839/1700] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:07.180070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4527-8f6c-4a4a-9ff9-aa7a4a6fbe54 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:07.189101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 862/1701] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:06 2022] POST /identity/v3/projects => generated 375 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:07.191089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96eec-2330-4d49-99c5-cd55ef90262c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:07.195322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-59f96eec-2330-4d49-99c5-cd55ef90262c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:07.210398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc4527-8f6c-4a4a-9ff9-aa7a4a6fbe54 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:07.364489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd07cf-a490-4db2-9c60-3c3f634cd514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:07.369237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd07cf-a490-4db2-9c60-3c3f634cd514 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:07.369965 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd07cf-a490-4db2-9c60-3c3f634cd514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:07.370705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd07cf-a490-4db2-9c60-3c3f634cd514 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:07.372728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd07cf-a490-4db2-9c60-3c3f634cd514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:07.377190 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96eec-2330-4d49-99c5-cd55ef90262c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:07.378631 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd07cf-a490-4db2-9c60-3c3f634cd514 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:07.394663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dec165-5497-4220-95c2-f398239e7383 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:07.395551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec165-5497-4220-95c2-f398239e7383 service swift] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:07.395907 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec165-5497-4220-95c2-f398239e7383 service swift] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:07.397399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dec165-5497-4220-95c2-f398239e7383 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:07.418157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 840/1702] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:07.421684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd07cf-a490-4db2-9c60-3c3f634cd514 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:07.449087 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd07cf-a490-4db2-9c60-3c3f634cd514 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:07.479816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863611-2e9f-42b4-8c02-59dd2bc0e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:07.482519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863611-2e9f-42b4-8c02-59dd2bc0e615 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:07.484581 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863611-2e9f-42b4-8c02-59dd2bc0e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:07.485953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92863611-2e9f-42b4-8c02-59dd2bc0e615 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:07.499466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92863611-2e9f-42b4-8c02-59dd2bc0e615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:07.510979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92863611-2e9f-42b4-8c02-59dd2bc0e615 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:07.557002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dec165-5497-4220-95c2-f398239e7383 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:07.561366 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dec165-5497-4220-95c2-f398239e7383 service swift] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:07.584044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 863/1703] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 12:55:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 12:55:07.589361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 841/1704] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:07 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:07.590020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dec165-5497-4220-95c2-f398239e7383 service swift] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:07.594192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863611-2e9f-42b4-8c02-59dd2bc0e615 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:07.623735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dec165-5497-4220-95c2-f398239e7383 service swift] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:07.642305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08191169-0514-4de9-b56a-94d083a9bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:07.643607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191169-0514-4de9-b56a-94d083a9bf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:07.643893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191169-0514-4de9-b56a-94d083a9bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:07.644172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191169-0514-4de9-b56a-94d083a9bf4a admin admin] PATH_INFO: `/v3/projects/b0a37819a33c4edea8de80cc0f30efc0/users/45b86f6596b94408a2be54c2fdd436e9/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:07.647296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08191169-0514-4de9-b56a-94d083a9bf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a37819a33c4edea8de80cc0f30efc0, user_id=45b86f6596b94408a2be54c2fdd436e9, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:07.658146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08191169-0514-4de9-b56a-94d083a9bf4a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:07.661869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92863611-2e9f-42b4-8c02-59dd2bc0e615 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:07.703457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 864/1705] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:07 2022] PUT /identity/v3/projects/b0a37819a33c4edea8de80cc0f30efc0/users/45b86f6596b94408a2be54c2fdd436e9/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:07.731613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b541a92-ca44-4983-93f3-7d66d9ac76a5 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:07.731963 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b541a92-ca44-4983-93f3-7d66d9ac76a5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:07.732248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b541a92-ca44-4983-93f3-7d66d9ac76a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:07.846478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-6b541a92-ca44-4983-93f3-7d66d9ac76a5 None None] MFA Rules not processed for user `45b86f6596b94408a2be54c2fdd436e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:07.848767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6b541a92-ca44-4983-93f3-7d66d9ac76a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:07.988709 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75d300-b6c0-45d9-a5c1-4657ba40dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:07.995873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75d300-b6c0-45d9-a5c1-4657ba40dd12 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:07.996465 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75d300-b6c0-45d9-a5c1-4657ba40dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:07.996988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75d300-b6c0-45d9-a5c1-4657ba40dd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:08.002830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75d300-b6c0-45d9-a5c1-4657ba40dd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:08.019628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75d300-b6c0-45d9-a5c1-4657ba40dd12 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:08.044092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 842/1706] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:08.057461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75d300-b6c0-45d9-a5c1-4657ba40dd12 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:08.096275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75d300-b6c0-45d9-a5c1-4657ba40dd12 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:08.119257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f83c-e941-4483-8dcf-c83b9040b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:08.120202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f83c-e941-4483-8dcf-c83b9040b696 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:08.120508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f83c-e941-4483-8dcf-c83b9040b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:08.120762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f83c-e941-4483-8dcf-c83b9040b696 admin admin] PATH_INFO: `/v3/projects/a6511058cbe34a4c804aa585c1959fb0/users/e03f8dfbfb084933bee0a093d7b40d40/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:08.157637 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302f83c-e941-4483-8dcf-c83b9040b696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6511058cbe34a4c804aa585c1959fb0, user_id=e03f8dfbfb084933bee0a093d7b40d40, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:08.178254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302f83c-e941-4483-8dcf-c83b9040b696 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:08.232285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 843/1707] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:08 2022] PUT /identity/v3/projects/a6511058cbe34a4c804aa585c1959fb0/users/e03f8dfbfb084933bee0a093d7b40d40/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:08.234994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f83c-e941-4483-8dcf-c83b9040b696 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:08.235140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 865/1708] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:08.241521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4302f83c-e941-4483-8dcf-c83b9040b696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:08.243251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b541a92-ca44-4983-93f3-7d66d9ac76a5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:08.330546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b541a92-ca44-4983-93f3-7d66d9ac76a5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:08.548070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f83c-e941-4483-8dcf-c83b9040b696 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:08.568412 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:08.569388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:08.574010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:08.574666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] PATH_INFO: `/v3/users/c7099ad53d0e4d328364905461c8b72f` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:08.586096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7099ad53d0e4d328364905461c8b72f)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:08.601224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:08.623304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5cf89-8f96-48b4-83db-d30a6af3d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:08.624527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5cf89-8f96-48b4-83db-d30a6af3d1fd admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:08.624943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5cf89-8f96-48b4-83db-d30a6af3d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:08.625416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5cf89-8f96-48b4-83db-d30a6af3d1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:08.626538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5cf89-8f96-48b4-83db-d30a6af3d1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:08.632649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5cf89-8f96-48b4-83db-d30a6af3d1fd admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:08.698923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 866/1709] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:08.700502 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5cf89-8f96-48b4-83db-d30a6af3d1fd admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:08.771990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7099ad53d0e4d328364905461c8b72f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:08.774086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7099ad53d0e4d328364905461c8b72f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:08.775238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7099ad53d0e4d328364905461c8b72f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:08.795448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7099ad53d0e4d328364905461c8b72f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:08.826374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7099ad53d0e4d328364905461c8b72f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:08.857928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 844/1710] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:08 2022] DELETE /identity/v3/users/c7099ad53d0e4d328364905461c8b72f => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:08.858862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:08.863557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:09.017271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5cf89-8f96-48b4-83db-d30a6af3d1fd admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:09.041782 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c421a-b7a4-4014-b83a-53e7e8bd4309 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:09.050574 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:09.051708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:09.051838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:09.052042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] PATH_INFO: `/v3/users/1db7cf357e20453fa62973ddcbff48ab` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:09.056401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db7cf357e20453fa62973ddcbff48ab)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:09.058740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:09.181564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1324b11b-5464-4792-9fdb-1f5edd712635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:09.186450 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b11b-5464-4792-9fdb-1f5edd712635 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:09.188701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b11b-5464-4792-9fdb-1f5edd712635 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:09.190019 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1324b11b-5464-4792-9fdb-1f5edd712635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:09.205747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1324b11b-5464-4792-9fdb-1f5edd712635 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:09.275987 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db7cf357e20453fa62973ddcbff48ab'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:09.280292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db7cf357e20453fa62973ddcbff48ab'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:09.282797 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db7cf357e20453fa62973ddcbff48ab'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:09.358207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db7cf357e20453fa62973ddcbff48ab'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:09.395199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db7cf357e20453fa62973ddcbff48ab'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:09.466891 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 845/1711] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:08 2022] DELETE /identity/v3/users/1db7cf357e20453fa62973ddcbff48ab => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:09.468146 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:09.484237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:09.681481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324b11b-5464-4792-9fdb-1f5edd712635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:09.685490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1324b11b-5464-4792-9fdb-1f5edd712635 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:09.712062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 867/1712] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 1012 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:09.717303 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f755ab2-1c9c-4e82-ae93-372831ce44fe None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:09.717965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f755ab2-1c9c-4e82-ae93-372831ce44fe None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:09.718392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f755ab2-1c9c-4e82-ae93-372831ce44fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:09.765391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056343e-9a66-4f55-9eb3-ac173583d227 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:09.782814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9b414-971e-402c-af87-d06dbf5b6d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:09.787829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b414-971e-402c-af87-d06dbf5b6d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:09.798655 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b414-971e-402c-af87-d06dbf5b6d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:09.798655 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9b414-971e-402c-af87-d06dbf5b6d84 admin admin] PATH_INFO: `/v3/projects/a6511058cbe34a4c804aa585c1959fb0/users/e03f8dfbfb084933bee0a093d7b40d40/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:09.815847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b414-971e-402c-af87-d06dbf5b6d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6511058cbe34a4c804aa585c1959fb0, user_id=e03f8dfbfb084933bee0a093d7b40d40, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:09.836405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9b414-971e-402c-af87-d06dbf5b6d84 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:09.838336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2f755ab2-1c9c-4e82-ae93-372831ce44fe None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:09.845786 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2f755ab2-1c9c-4e82-ae93-372831ce44fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:09.882807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 868/1713] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:09.889976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 846/1714] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:09 2022] PUT /identity/v3/projects/a6511058cbe34a4c804aa585c1959fb0/users/e03f8dfbfb084933bee0a093d7b40d40/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:09.891803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74574f2-b9a6-4f2a-bf69-25277c486f24 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:09.892532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74574f2-b9a6-4f2a-bf69-25277c486f24 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:09.893154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74574f2-b9a6-4f2a-bf69-25277c486f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:09.895649 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206bca6-1df4-4f23-a568-34323e55fc77 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:09.899169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206bca6-1df4-4f23-a568-34323e55fc77 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:09.900443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206bca6-1df4-4f23-a568-34323e55fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:09.982162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-c74574f2-b9a6-4f2a-bf69-25277c486f24 None None] MFA Rules not processed for user `7bd327cdfe2c4f729252d86838aae638`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:09.989037 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c74574f2-b9a6-4f2a-bf69-25277c486f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:09.991031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-0206bca6-1df4-4f23-a568-34323e55fc77 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:09.995515 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0206bca6-1df4-4f23-a568-34323e55fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:10.207521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 869/1715] 10.222.0.11 () {58 vars in 1015 bytes} [Wed Apr 6 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:10.209071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74574f2-b9a6-4f2a-bf69-25277c486f24 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:10.211613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c74574f2-b9a6-4f2a-bf69-25277c486f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:10.282669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74574f2-b9a6-4f2a-bf69-25277c486f24 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:10.284598 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 847/1716] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:10.290592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b190-14ad-4f58-abfb-038d2331923d None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:10.292722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462ee5e-cb22-4fe5-a939-cb20593e6017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:10.295529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462ee5e-cb22-4fe5-a939-cb20593e6017 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:10.296278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462ee5e-cb22-4fe5-a939-cb20593e6017 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:10.296964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462ee5e-cb22-4fe5-a939-cb20593e6017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:10.298704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b190-14ad-4f58-abfb-038d2331923d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:10.299510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3b190-14ad-4f58-abfb-038d2331923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:10.345818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462ee5e-cb22-4fe5-a939-cb20593e6017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:10.349707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462ee5e-cb22-4fe5-a939-cb20593e6017 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:10.400022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-18b3b190-14ad-4f58-abfb-038d2331923d None None] MFA Rules not processed for user `e03f8dfbfb084933bee0a093d7b40d40`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:10.402426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-18b3b190-14ad-4f58-abfb-038d2331923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:10.410406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 870/1717] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:10.412246 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462ee5e-cb22-4fe5-a939-cb20593e6017 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:10.445787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462ee5e-cb22-4fe5-a939-cb20593e6017 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:10.463025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f866-da36-48a8-8923-c6b582e6e4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:10.464748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f866-da36-48a8-8923-c6b582e6e4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:10.465458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f866-da36-48a8-8923-c6b582e6e4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:10.466919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3f866-da36-48a8-8923-c6b582e6e4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:10.491491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3f866-da36-48a8-8923-c6b582e6e4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:10.494515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f3f866-da36-48a8-8923-c6b582e6e4c6 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:10.541834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 871/1718] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:10.543159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f866-da36-48a8-8923-c6b582e6e4c6 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:10.597060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3f866-da36-48a8-8923-c6b582e6e4c6 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:10.614394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7cbc-e475-4f9f-b412-5cc2726507ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:10.615670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7cbc-e475-4f9f-b412-5cc2726507ac service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:10.617255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7cbc-e475-4f9f-b412-5cc2726507ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:10.618865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb7cbc-e475-4f9f-b412-5cc2726507ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:10.671732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb7cbc-e475-4f9f-b412-5cc2726507ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:10.674423 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb7cbc-e475-4f9f-b412-5cc2726507ac service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:10.761769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 872/1719] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:10.823820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 848/1720] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 539 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:10.915593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7cbc-e475-4f9f-b412-5cc2726507ac service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:10.917595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6bdb7cbc-e475-4f9f-b412-5cc2726507ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:11.108243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb7cbc-e475-4f9f-b412-5cc2726507ac service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:11.132438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6aa20-4559-4835-b6c1-ff8dbc6e7755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:11.133748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6aa20-4559-4835-b6c1-ff8dbc6e7755 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:11.134230 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6aa20-4559-4835-b6c1-ff8dbc6e7755 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:11.134714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6aa20-4559-4835-b6c1-ff8dbc6e7755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:11.138819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b9b6aa20-4559-4835-b6c1-ff8dbc6e7755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:11.403751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6aa20-4559-4835-b6c1-ff8dbc6e7755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:11.405356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6aa20-4559-4835-b6c1-ff8dbc6e7755 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:11.441620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 873/1721] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:12.815813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3b190-14ad-4f58-abfb-038d2331923d None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:12.817549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-18b3b190-14ad-4f58-abfb-038d2331923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:12.857399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3b190-14ad-4f58-abfb-038d2331923d None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:12.867314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:12.869785 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:12.873706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:12.874262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] PATH_INFO: `/v3/users/7b5407235e334ddabe02508bc29734dc` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:12.877170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5407235e334ddabe02508bc29734dc)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:12.886975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:13.051178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5407235e334ddabe02508bc29734dc'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:13.054272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5407235e334ddabe02508bc29734dc'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:13.064956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5407235e334ddabe02508bc29734dc'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:13.084414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5407235e334ddabe02508bc29734dc'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:13.117708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5407235e334ddabe02508bc29734dc'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:13.152035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 849/1722] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:12 2022] DELETE /identity/v3/users/7b5407235e334ddabe02508bc29734dc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:13.154564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04823-07ff-4319-a2a9-ce3ca7133d33 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:13.155519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04823-07ff-4319-a2a9-ce3ca7133d33 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:13.156114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc04823-07ff-4319-a2a9-ce3ca7133d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:13.274046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2dc04823-07ff-4319-a2a9-ce3ca7133d33 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:13.280843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2dc04823-07ff-4319-a2a9-ce3ca7133d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:13.608962 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 874/1723] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:13.703551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:13.705500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:13.876743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc04823-07ff-4319-a2a9-ce3ca7133d33 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:13.878287 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2dc04823-07ff-4319-a2a9-ce3ca7133d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:13.930118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc04823-07ff-4319-a2a9-ce3ca7133d33 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:13.939594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50258328-9240-408c-bf84-5f870ff18b65 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:13.941416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:13.943878 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:13.944930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:13.945767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] PATH_INFO: `/v3/projects/2001e305e71946f1a13810cf528cca0d` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:13.952649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2001e305e71946f1a13810cf528cca0d)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:13.956508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb2650-ef0d-4648-b2ec-ef8e1c4651e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:13.957765 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2650-ef0d-4648-b2ec-ef8e1c4651e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:13.958242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2650-ef0d-4648-b2ec-ef8e1c4651e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:13.958884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:13.959338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb2650-ef0d-4648-b2ec-ef8e1c4651e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:14.003004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb2650-ef0d-4648-b2ec-ef8e1c4651e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:14.010009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb2650-ef0d-4648-b2ec-ef8e1c4651e2 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:14.056174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 850/1724] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:14.198820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2001e305e71946f1a13810cf528cca0d', 'request_id': 'req-e70a79a0-c10e-4749-9ffc-175af7d40954'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:14.234618 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2001e305e71946f1a13810cf528cca0d', 'request_id': 'req-e70a79a0-c10e-4749-9ffc-175af7d40954'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:14.268785 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2001e305e71946f1a13810cf528cca0d', 'request_id': 'req-e70a79a0-c10e-4749-9ffc-175af7d40954'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:14.409603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] The token cache is being invalidate because project 2001e305e71946f1a13810cf528cca0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:14.410420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:14.419743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e70a79a0-c10e-4749-9ffc-175af7d40954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:14.462398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 875/1725] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:13 2022] DELETE /identity/v3/projects/2001e305e71946f1a13810cf528cca0d => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:55:14.469262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa42884-210f-4559-af1b-482d226f8824 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:14.469733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa42884-210f-4559-af1b-482d226f8824 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:14.470634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa42884-210f-4559-af1b-482d226f8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:14.538605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-baa42884-210f-4559-af1b-482d226f8824 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:14.540218 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-baa42884-210f-4559-af1b-482d226f8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:14.746330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a915ee1-31ec-4d15-8782-999256e3c084 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:14.747631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a915ee1-31ec-4d15-8782-999256e3c084 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:14.749219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a915ee1-31ec-4d15-8782-999256e3c084 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:14.752460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 876/1726] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 12:55:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:55:14.759707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 851/1727] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:14.773040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a1a0-d8d6-442e-995c-fe587bcc149c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:14.773561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a1a0-d8d6-442e-995c-fe587bcc149c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:14.774097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96a1a0-d8d6-442e-995c-fe587bcc149c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:14.782307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc689e-5715-46c7-8ca5-52dfa6aba401 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:14.783759 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc689e-5715-46c7-8ca5-52dfa6aba401 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:14.784300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc689e-5715-46c7-8ca5-52dfa6aba401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:14.836311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-6dfc689e-5715-46c7-8ca5-52dfa6aba401 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:14.838579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6dfc689e-5715-46c7-8ca5-52dfa6aba401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:14.853700 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3d96a1a0-d8d6-442e-995c-fe587bcc149c None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:14.855861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3d96a1a0-d8d6-442e-995c-fe587bcc149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:14.871350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 852/1728] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:14.873139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc689e-5715-46c7-8ca5-52dfa6aba401 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:14.892820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc689e-5715-46c7-8ca5-52dfa6aba401 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:14.912898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af1d27-c559-4be4-9d50-5030e72f6da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:14.914012 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1d27-c559-4be4-9d50-5030e72f6da7 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:14.914689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1d27-c559-4be4-9d50-5030e72f6da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:14.915358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af1d27-c559-4be4-9d50-5030e72f6da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:14.916811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af1d27-c559-4be4-9d50-5030e72f6da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:14.917497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af1d27-c559-4be4-9d50-5030e72f6da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:14.921834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af1d27-c559-4be4-9d50-5030e72f6da7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:15.003151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 853/1729] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:15.011282 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af1d27-c559-4be4-9d50-5030e72f6da7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:15.056133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af1d27-c559-4be4-9d50-5030e72f6da7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:15.079752 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fc0b6-928b-45a3-b501-3d70023736dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:15.080438 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc0b6-928b-45a3-b501-3d70023736dd admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:15.080726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc0b6-928b-45a3-b501-3d70023736dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:15.081008 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc0b6-928b-45a3-b501-3d70023736dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:15.081746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fc0b6-928b-45a3-b501-3d70023736dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:15.091457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fc0b6-928b-45a3-b501-3d70023736dd admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:15.119740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 877/1730] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 12:55:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:15.137084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96a1a0-d8d6-442e-995c-fe587bcc149c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:15.139383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3d96a1a0-d8d6-442e-995c-fe587bcc149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:15.171716 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96a1a0-d8d6-442e-995c-fe587bcc149c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:15.188340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6c110-9165-4f2d-af00-f4bdce93eeaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:15.189299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 854/1731] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:15 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:15.195597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6c110-9165-4f2d-af00-f4bdce93eeaf service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:15.196590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fc0b6-928b-45a3-b501-3d70023736dd admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:15.198378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6c110-9165-4f2d-af00-f4bdce93eeaf service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:15.198888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6c110-9165-4f2d-af00-f4bdce93eeaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:15.222446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6c110-9165-4f2d-af00-f4bdce93eeaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:15.224955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6c110-9165-4f2d-af00-f4bdce93eeaf service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:15.257226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 878/1732] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:55:15.376573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6c110-9165-4f2d-af00-f4bdce93eeaf service nova] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:15.380680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-53e6c110-9165-4f2d-af00-f4bdce93eeaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:15.429017 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6c110-9165-4f2d-af00-f4bdce93eeaf service nova] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:15.512303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fc0b6-928b-45a3-b501-3d70023736dd admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:15.522985 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49215761-3dde-4c28-afe3-1e3b6af0661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:15.524574 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215761-3dde-4c28-afe3-1e3b6af0661d admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:15.526427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215761-3dde-4c28-afe3-1e3b6af0661d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:15.527078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215761-3dde-4c28-afe3-1e3b6af0661d admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:15.528757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49215761-3dde-4c28-afe3-1e3b6af0661d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:15.533118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49215761-3dde-4c28-afe3-1e3b6af0661d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:15.550330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:15.551354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:15.551719 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:15.552073 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] PATH_INFO: `/v3/projects/de12ed9ce92e4fe7a16df22b27b3a465` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:15.554564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=de12ed9ce92e4fe7a16df22b27b3a465)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:15.556821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:15.588700 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 855/1733] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:15 2022] POST /identity/v3/users => generated 290 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:55:15.594279 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee9088-ebad-45ff-8c37-b558baf797c3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:15.596241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee9088-ebad-45ff-8c37-b558baf797c3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:15.597129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee9088-ebad-45ff-8c37-b558baf797c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:15.676286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-50ee9088-ebad-45ff-8c37-b558baf797c3 None None] MFA Rules not processed for user `c07f9210231742ffac3dae4b75887d66`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:15.679880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-50ee9088-ebad-45ff-8c37-b558baf797c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:15.681773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de12ed9ce92e4fe7a16df22b27b3a465', 'request_id': 'req-7333bdb1-2a84-4221-855e-8ef076f426fc'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:15.695125 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de12ed9ce92e4fe7a16df22b27b3a465', 'request_id': 'req-7333bdb1-2a84-4221-855e-8ef076f426fc'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:15.713760 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de12ed9ce92e4fe7a16df22b27b3a465', 'request_id': 'req-7333bdb1-2a84-4221-855e-8ef076f426fc'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:15.733560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] The token cache is being invalidate because project de12ed9ce92e4fe7a16df22b27b3a465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:15.734146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:15.735569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:15.738079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 879/1734] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:15 2022] DELETE /identity/v3/projects/de12ed9ce92e4fe7a16df22b27b3a465 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:15.739156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:15.742601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:15.777220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 856/1735] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:15.779287 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee9088-ebad-45ff-8c37-b558baf797c3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:15.781011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-50ee9088-ebad-45ff-8c37-b558baf797c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:15.918116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333bdb1-2a84-4221-855e-8ef076f426fc admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:15.929284 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adde550-78ff-421a-aaed-5589e498a826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:15.929935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adde550-78ff-421a-aaed-5589e498a826 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:15.931384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adde550-78ff-421a-aaed-5589e498a826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:15.931673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adde550-78ff-421a-aaed-5589e498a826 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:15.932444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adde550-78ff-421a-aaed-5589e498a826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:15.934130 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adde550-78ff-421a-aaed-5589e498a826 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:15.954116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee9088-ebad-45ff-8c37-b558baf797c3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:15.965188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 880/1736] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:15.968149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adde550-78ff-421a-aaed-5589e498a826 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:15.971762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:15.972805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:15.973083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:15.973354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] PATH_INFO: `/v3/projects/b4082715dd2c4d6f9b9a2691c78a1cd2` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:15.975817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2adde550-78ff-421a-aaed-5589e498a826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:15.977963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4082715dd2c4d6f9b9a2691c78a1cd2)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:15.980009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:16.029865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adde550-78ff-421a-aaed-5589e498a826 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:16.052945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:16.058336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:16.059250 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:16.061363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] PATH_INFO: `/v3/users/45b86f6596b94408a2be54c2fdd436e9` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:16.068632 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b86f6596b94408a2be54c2fdd436e9)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:16.074992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:16.114866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4082715dd2c4d6f9b9a2691c78a1cd2', 'request_id': 'req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:16.129209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4082715dd2c4d6f9b9a2691c78a1cd2', 'request_id': 'req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:16.151707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4082715dd2c4d6f9b9a2691c78a1cd2', 'request_id': 'req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:16.201749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] The token cache is being invalidate because project b4082715dd2c4d6f9b9a2691c78a1cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:16.202240 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:16.204493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:16.210820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 857/1737] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:15 2022] DELETE /identity/v3/projects/b4082715dd2c4d6f9b9a2691c78a1cd2 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:16.212714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b86f6596b94408a2be54c2fdd436e9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:16.213719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:16.214159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b86f6596b94408a2be54c2fdd436e9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:16.216147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b86f6596b94408a2be54c2fdd436e9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:16.217207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:16.282394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b86f6596b94408a2be54c2fdd436e9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:16.321898 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b86f6596b94408a2be54c2fdd436e9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:16.347510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 881/1738] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:15 2022] DELETE /identity/v3/users/45b86f6596b94408a2be54c2fdd436e9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:16.349150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:16.352539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:16.542347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98538ac8-b87b-4c86-abe0-69d7c2fff8f6 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:16.672162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1328d1-4a6c-4731-8a27-dabb8533b979 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:16.735205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ecf37-8606-4a07-af10-4788d0ad9030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:16.738599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ecf37-8606-4a07-af10-4788d0ad9030 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:16.747876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ecf37-8606-4a07-af10-4788d0ad9030 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:16.748225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ecf37-8606-4a07-af10-4788d0ad9030 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:16.750680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ecf37-8606-4a07-af10-4788d0ad9030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:16.756723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ecf37-8606-4a07-af10-4788d0ad9030 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:16.787183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 882/1739] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:16.787183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee2022-aaa8-43dd-8952-5eccfc291512 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:16.787183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee2022-aaa8-43dd-8952-5eccfc291512 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:16.787183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee2022-aaa8-43dd-8952-5eccfc291512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:16.853400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79aed60-1699-4908-b283-ba0a870efe47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:16.861278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aed60-1699-4908-b283-ba0a870efe47 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:16.862131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aed60-1699-4908-b283-ba0a870efe47 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:16.862644 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aed60-1699-4908-b283-ba0a870efe47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:16.865652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-46ee2022-aaa8-43dd-8952-5eccfc291512 None None] MFA Rules not processed for user `c9e498e3dae54ffab54d93958bfc2ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:16.867862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d79aed60-1699-4908-b283-ba0a870efe47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:16.870674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-46ee2022-aaa8-43dd-8952-5eccfc291512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:17.034774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aed60-1699-4908-b283-ba0a870efe47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:17.037776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aed60-1699-4908-b283-ba0a870efe47 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:17.063478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 858/1740] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 852 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:17.064809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553315-e574-4587-9cc7-21fc75ea25de None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:17.065196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553315-e574-4587-9cc7-21fc75ea25de None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:17.065594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553315-e574-4587-9cc7-21fc75ea25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:17.107156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 883/1741] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:17.111293 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee2022-aaa8-43dd-8952-5eccfc291512 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:17.125989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-dc553315-e574-4587-9cc7-21fc75ea25de None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:17.130397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-dc553315-e574-4587-9cc7-21fc75ea25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:17.150358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 859/1742] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:17.154691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3222e3-fb87-4655-affb-19e689501c3c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:17.156571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3222e3-fb87-4655-affb-19e689501c3c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:17.158578 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3222e3-fb87-4655-affb-19e689501c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:17.160892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee2022-aaa8-43dd-8952-5eccfc291512 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:17.180266 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cf7c6-d450-49c1-8b0e-8986b11613b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:17.181349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cf7c6-d450-49c1-8b0e-8986b11613b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:17.181693 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cf7c6-d450-49c1-8b0e-8986b11613b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:17.181975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532cf7c6-d450-49c1-8b0e-8986b11613b9 admin admin] PATH_INFO: `/v3/projects/e062e6dd9d154092909c1c4784e9f71a/users/38ae6b5070fc47c890ef8ecddf794885/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:17.199723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3a3222e3-fb87-4655-affb-19e689501c3c None None] MFA Rules not processed for user `c9e498e3dae54ffab54d93958bfc2ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:17.208114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3a3222e3-fb87-4655-affb-19e689501c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:17.227888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 860/1743] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:17.254889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc14953-5647-4da4-afb8-6b4ec6827992 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:17.255425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc14953-5647-4da4-afb8-6b4ec6827992 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:17.255806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc14953-5647-4da4-afb8-6b4ec6827992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:17.264932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cf7c6-d450-49c1-8b0e-8986b11613b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e062e6dd9d154092909c1c4784e9f71a, user_id=38ae6b5070fc47c890ef8ecddf794885, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:17.277404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532cf7c6-d450-49c1-8b0e-8986b11613b9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:17.322391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-cbc14953-5647-4da4-afb8-6b4ec6827992 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:17.331684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 884/1744] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:17 2022] PUT /identity/v3/projects/e062e6dd9d154092909c1c4784e9f71a/users/38ae6b5070fc47c890ef8ecddf794885/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:17.334427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-cbc14953-5647-4da4-afb8-6b4ec6827992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:17.345453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cf7c6-d450-49c1-8b0e-8986b11613b9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:17.348772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-532cf7c6-d450-49c1-8b0e-8986b11613b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:17.514558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532cf7c6-d450-49c1-8b0e-8986b11613b9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:17.520276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 861/1745] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:17.526131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e49eb-b88d-4fb4-9e4f-891b45e094e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:17.527071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e49eb-b88d-4fb4-9e4f-891b45e094e8 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:17.527344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e49eb-b88d-4fb4-9e4f-891b45e094e8 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:17.527502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59336878-a28b-4c31-8c9b-0ca1e99352e3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:17.527685 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59336878-a28b-4c31-8c9b-0ca1e99352e3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:17.527884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e49eb-b88d-4fb4-9e4f-891b45e094e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:17.528938 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59336878-a28b-4c31-8c9b-0ca1e99352e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:17.604840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-59336878-a28b-4c31-8c9b-0ca1e99352e3 None None] MFA Rules not processed for user `38ae6b5070fc47c890ef8ecddf794885`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:17.609893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-59336878-a28b-4c31-8c9b-0ca1e99352e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:17.716733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e49eb-b88d-4fb4-9e4f-891b45e094e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:17.719964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e49eb-b88d-4fb4-9e4f-891b45e094e8 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:17.732992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 885/1746] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:17.733957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e49eb-b88d-4fb4-9e4f-891b45e094e8 service nova] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:17.735657 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6e4e49eb-b88d-4fb4-9e4f-891b45e094e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:17.754522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e49eb-b88d-4fb4-9e4f-891b45e094e8 service nova] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:17.765031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:17.765471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:17.766869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:17.767161 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] PATH_INFO: `/v3/projects/b0a37819a33c4edea8de80cc0f30efc0` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:17.768904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a37819a33c4edea8de80cc0f30efc0)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:17.774456 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:17.796542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 862/1747] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:17.797381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59336878-a28b-4c31-8c9b-0ca1e99352e3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:17.830973 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59336878-a28b-4c31-8c9b-0ca1e99352e3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:17.843155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3fb0-73a0-490a-8b01-edd8416b746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:17.844326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3fb0-73a0-490a-8b01-edd8416b746b admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:17.844990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3fb0-73a0-490a-8b01-edd8416b746b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:17.845813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb3fb0-73a0-490a-8b01-edd8416b746b admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:17.847243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb3fb0-73a0-490a-8b01-edd8416b746b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:17.847763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb3fb0-73a0-490a-8b01-edd8416b746b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:17.851648 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb3fb0-73a0-490a-8b01-edd8416b746b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:17.884838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a37819a33c4edea8de80cc0f30efc0', 'request_id': 'req-c313754c-1677-44ed-9e5f-b15f5a44f9eb'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:17.892564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a37819a33c4edea8de80cc0f30efc0', 'request_id': 'req-c313754c-1677-44ed-9e5f-b15f5a44f9eb'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:17.893384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 863/1748] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:17.894925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3fb0-73a0-490a-8b01-edd8416b746b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:17.908590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a37819a33c4edea8de80cc0f30efc0', 'request_id': 'req-c313754c-1677-44ed-9e5f-b15f5a44f9eb'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:17.920990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb3fb0-73a0-490a-8b01-edd8416b746b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:17.925071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] The token cache is being invalidate because project b0a37819a33c4edea8de80cc0f30efc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:17.925410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:17.926128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:17.928675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 886/1749] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:17 2022] DELETE /identity/v3/projects/b0a37819a33c4edea8de80cc0f30efc0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:17.928960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:17.930410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:18.041857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313754c-1677-44ed-9e5f-b15f5a44f9eb admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:18.048990 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fd69e-977d-43c6-9698-4c26c92174c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:18.049710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fd69e-977d-43c6-9698-4c26c92174c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:18.050101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fd69e-977d-43c6-9698-4c26c92174c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:18.050483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fd69e-977d-43c6-9698-4c26c92174c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:18.051293 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fd69e-977d-43c6-9698-4c26c92174c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:18.053593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fd69e-977d-43c6-9698-4c26c92174c6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:18.066878 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392fa2b-5fc6-4d01-9b29-6a99ce171b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:18.072818 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392fa2b-5fc6-4d01-9b29-6a99ce171b07 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:18.077415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392fa2b-5fc6-4d01-9b29-6a99ce171b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:18.078187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392fa2b-5fc6-4d01-9b29-6a99ce171b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:18.083109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392fa2b-5fc6-4d01-9b29-6a99ce171b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:18.090331 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392fa2b-5fc6-4d01-9b29-6a99ce171b07 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:18.105914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 887/1750] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:17 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:18.109502 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1926397-8905-4499-ba1b-8f8c7c7d9118 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:18.110406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1926397-8905-4499-ba1b-8f8c7c7d9118 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:18.113958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1926397-8905-4499-ba1b-8f8c7c7d9118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:18.231880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-f1926397-8905-4499-ba1b-8f8c7c7d9118 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:18.234056 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f1926397-8905-4499-ba1b-8f8c7c7d9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:18.235741 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 864/1751] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:17 2022] POST /identity/v3/projects => generated 381 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:18.237078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392fa2b-5fc6-4d01-9b29-6a99ce171b07 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:18.496444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392fa2b-5fc6-4d01-9b29-6a99ce171b07 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:18.529864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be9563-0f45-4fc0-9c50-dab7d9967505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:18.538233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be9563-0f45-4fc0-9c50-dab7d9967505 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:18.539779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 888/1752] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:18.541005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1926397-8905-4499-ba1b-8f8c7c7d9118 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:18.541422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be9563-0f45-4fc0-9c50-dab7d9967505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:18.542155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be9563-0f45-4fc0-9c50-dab7d9967505 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:18.543790 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be9563-0f45-4fc0-9c50-dab7d9967505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:18.547760 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f1926397-8905-4499-ba1b-8f8c7c7d9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:18.556089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be9563-0f45-4fc0-9c50-dab7d9967505 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:18.575082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1926397-8905-4499-ba1b-8f8c7c7d9118 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:18.584461 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af158e07-64cc-4fe4-a2ed-d2280c346668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:18.585881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af158e07-64cc-4fe4-a2ed-d2280c346668 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:18.586385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af158e07-64cc-4fe4-a2ed-d2280c346668 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:18.586829 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af158e07-64cc-4fe4-a2ed-d2280c346668 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:18.588363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af158e07-64cc-4fe4-a2ed-d2280c346668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:18.592751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af158e07-64cc-4fe4-a2ed-d2280c346668 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:18.629612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 865/1753] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:18 2022] POST /identity/v3/users => generated 303 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:18.636301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a53a-d207-454a-bd28-36e7d3799bc3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:18.636928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a53a-d207-454a-bd28-36e7d3799bc3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:18.637496 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37a53a-d207-454a-bd28-36e7d3799bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:18.647191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 889/1754] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:18 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:18.657078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af158e07-64cc-4fe4-a2ed-d2280c346668 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:18.702103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af158e07-64cc-4fe4-a2ed-d2280c346668 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:18.709834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-1f37a53a-d207-454a-bd28-36e7d3799bc3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:18.716963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1f37a53a-d207-454a-bd28-36e7d3799bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:18.727033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99e0e-8f95-41e8-bb37-fd9e9004ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:18.728657 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99e0e-8f95-41e8-bb37-fd9e9004ecad admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:18.731099 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99e0e-8f95-41e8-bb37-fd9e9004ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:18.732735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99e0e-8f95-41e8-bb37-fd9e9004ecad admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:18.734888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab99e0e-8f95-41e8-bb37-fd9e9004ecad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:18.749851 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab99e0e-8f95-41e8-bb37-fd9e9004ecad admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:18.795742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 890/1755] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:18.801757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 866/1756] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:18.805216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99e0e-8f95-41e8-bb37-fd9e9004ecad admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:18.810635 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a53a-d207-454a-bd28-36e7d3799bc3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:18.837481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99e0e-8f95-41e8-bb37-fd9e9004ecad admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:18.845117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208215c7-4918-45b3-90fa-3851f1005f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:18.846370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208215c7-4918-45b3-90fa-3851f1005f87 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:18.847138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208215c7-4918-45b3-90fa-3851f1005f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:18.847755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208215c7-4918-45b3-90fa-3851f1005f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:18.849004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208215c7-4918-45b3-90fa-3851f1005f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:18.851099 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208215c7-4918-45b3-90fa-3851f1005f87 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:18.860288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37a53a-d207-454a-bd28-36e7d3799bc3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:18.886651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc8879-c249-40b2-a8ca-c173ad00bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:18.894922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc8879-c249-40b2-a8ca-c173ad00bca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:18.894922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc8879-c249-40b2-a8ca-c173ad00bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:18.894922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc8879-c249-40b2-a8ca-c173ad00bca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:18.900608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc8879-c249-40b2-a8ca-c173ad00bca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:18.909616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 891/1757] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:18.910016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc8879-c249-40b2-a8ca-c173ad00bca8 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:18.913731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208215c7-4918-45b3-90fa-3851f1005f87 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:18.962848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208215c7-4918-45b3-90fa-3851f1005f87 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:18.970733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 867/1758] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:18.972719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc8879-c249-40b2-a8ca-c173ad00bca8 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:18.980872 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41a2cd-45f0-44c2-ad44-a047b03bc538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:18.982561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41a2cd-45f0-44c2-ad44-a047b03bc538 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:18.983791 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41a2cd-45f0-44c2-ad44-a047b03bc538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:18.984692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41a2cd-45f0-44c2-ad44-a047b03bc538 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:18.988771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41a2cd-45f0-44c2-ad44-a047b03bc538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:18.988771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41a2cd-45f0-44c2-ad44-a047b03bc538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:18.992637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41a2cd-45f0-44c2-ad44-a047b03bc538 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:19.019902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 892/1759] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:19.023392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41a2cd-45f0-44c2-ad44-a047b03bc538 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:19.030426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc8879-c249-40b2-a8ca-c173ad00bca8 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:19.055449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41a2cd-45f0-44c2-ad44-a047b03bc538 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:19.064512 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e11d94-0d8c-47dd-824d-4f06e871865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:19.070633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f8d5c-397c-46e5-87cc-a39bae467d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:19.073817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f8d5c-397c-46e5-87cc-a39bae467d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:19.074550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e11d94-0d8c-47dd-824d-4f06e871865b admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:19.074719 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f8d5c-397c-46e5-87cc-a39bae467d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:19.075576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e11d94-0d8c-47dd-824d-4f06e871865b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:19.076005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e11d94-0d8c-47dd-824d-4f06e871865b admin admin] PATH_INFO: `/v3/projects/54489228f6b141ed8f9db812b15c01f4/users/f007c4060a55467ba7be187c8d7c0229/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:19.077801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f8d5c-397c-46e5-87cc-a39bae467d52 admin admin] PATH_INFO: `/v3/projects/113ad226f00d467b880c2d6312b83be6/users/de5a97c449b9446b959d1ef7b92d5946/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:19.192477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f8d5c-397c-46e5-87cc-a39bae467d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=113ad226f00d467b880c2d6312b83be6, user_id=de5a97c449b9446b959d1ef7b92d5946, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:19.195096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e11d94-0d8c-47dd-824d-4f06e871865b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54489228f6b141ed8f9db812b15c01f4, user_id=f007c4060a55467ba7be187c8d7c0229, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:19.205228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f8d5c-397c-46e5-87cc-a39bae467d52 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:19.219024 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e11d94-0d8c-47dd-824d-4f06e871865b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:19.290869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 868/1760] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:18 2022] PUT /identity/v3/projects/54489228f6b141ed8f9db812b15c01f4/users/f007c4060a55467ba7be187c8d7c0229/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:19.292421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e11d94-0d8c-47dd-824d-4f06e871865b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:19.295380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 893/1761] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:19 2022] PUT /identity/v3/projects/113ad226f00d467b880c2d6312b83be6/users/de5a97c449b9446b959d1ef7b92d5946/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:19.299247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f8d5c-397c-46e5-87cc-a39bae467d52 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:19.557935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f8d5c-397c-46e5-87cc-a39bae467d52 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:19.570647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c674e-9491-4194-89f8-2fff83f3c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:19.573430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c674e-9491-4194-89f8-2fff83f3c306 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:19.574042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c674e-9491-4194-89f8-2fff83f3c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:19.574387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c674e-9491-4194-89f8-2fff83f3c306 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:19.576716 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c674e-9491-4194-89f8-2fff83f3c306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:19.582012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c674e-9491-4194-89f8-2fff83f3c306 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:19.617625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 894/1762] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:19.620801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a85ba-3896-4575-b91a-205d2276b7db None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:19.623950 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a85ba-3896-4575-b91a-205d2276b7db None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:19.624276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a85ba-3896-4575-b91a-205d2276b7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:19.657037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e11d94-0d8c-47dd-824d-4f06e871865b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:19.677122 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2907-0f16-4de2-926a-4207bbc3218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:19.678218 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2907-0f16-4de2-926a-4207bbc3218a admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:19.678659 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2907-0f16-4de2-926a-4207bbc3218a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:19.679095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da2907-0f16-4de2-926a-4207bbc3218a admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:19.680359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da2907-0f16-4de2-926a-4207bbc3218a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:19.689526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da2907-0f16-4de2-926a-4207bbc3218a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:19.706863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2a8a85ba-3896-4575-b91a-205d2276b7db None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:19.708834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2a8a85ba-3896-4575-b91a-205d2276b7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:19.759274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 895/1763] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:19.769024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a85ba-3896-4575-b91a-205d2276b7db None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:19.771478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2a8a85ba-3896-4575-b91a-205d2276b7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:19.788978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 869/1764] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:19 2022] POST /identity/v3/projects => generated 369 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:19.790203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2907-0f16-4de2-926a-4207bbc3218a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:19.945427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da2907-0f16-4de2-926a-4207bbc3218a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:19.984262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618de30-d164-4308-a119-8ea3a8c93bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:19.985794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618de30-d164-4308-a119-8ea3a8c93bab admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:19.986362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618de30-d164-4308-a119-8ea3a8c93bab admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:19.986919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618de30-d164-4308-a119-8ea3a8c93bab admin admin] PATH_INFO: `/v3/projects/54489228f6b141ed8f9db812b15c01f4/users/f007c4060a55467ba7be187c8d7c0229/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:19.990825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618de30-d164-4308-a119-8ea3a8c93bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=54489228f6b141ed8f9db812b15c01f4, user_id=f007c4060a55467ba7be187c8d7c0229, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:19.994738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618de30-d164-4308-a119-8ea3a8c93bab admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:20.028954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 870/1765] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:19 2022] PUT /identity/v3/projects/54489228f6b141ed8f9db812b15c01f4/users/f007c4060a55467ba7be187c8d7c0229/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:20.030202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618de30-d164-4308-a119-8ea3a8c93bab admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:20.038895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3618de30-d164-4308-a119-8ea3a8c93bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:20.066295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a85ba-3896-4575-b91a-205d2276b7db None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:20.214842 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618de30-d164-4308-a119-8ea3a8c93bab admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:20.225939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96aaa5-221d-43c5-bc82-4cea7b81519b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:20.226674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96aaa5-221d-43c5-bc82-4cea7b81519b service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:20.228144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96aaa5-221d-43c5-bc82-4cea7b81519b service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:20.228441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96aaa5-221d-43c5-bc82-4cea7b81519b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:20.339208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff181a7-a485-4dc2-baf5-6b26cb006b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:20.342823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff181a7-a485-4dc2-baf5-6b26cb006b2c service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:20.346309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff181a7-a485-4dc2-baf5-6b26cb006b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:20.350100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff181a7-a485-4dc2-baf5-6b26cb006b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:20.358169 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-fff181a7-a485-4dc2-baf5-6b26cb006b2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:20.502561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96aaa5-221d-43c5-bc82-4cea7b81519b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:20.504807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96aaa5-221d-43c5-bc82-4cea7b81519b service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:20.560145 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 871/1766] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:20.571876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96aaa5-221d-43c5-bc82-4cea7b81519b service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:20.629885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96aaa5-221d-43c5-bc82-4cea7b81519b service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:20.659937 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fae5d-debe-4738-904d-e97404fe571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:20.661880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fae5d-debe-4738-904d-e97404fe571c admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:20.661880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fae5d-debe-4738-904d-e97404fe571c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:20.662143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fae5d-debe-4738-904d-e97404fe571c admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:20.662726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fae5d-debe-4738-904d-e97404fe571c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:20.664725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fae5d-debe-4738-904d-e97404fe571c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:20.751935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 872/1767] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:20 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:20.761365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc630409-c01d-4d30-8695-f7800457879a None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:20.761880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc630409-c01d-4d30-8695-f7800457879a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:20.763712 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc630409-c01d-4d30-8695-f7800457879a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:20.793373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff181a7-a485-4dc2-baf5-6b26cb006b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:20.795868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff181a7-a485-4dc2-baf5-6b26cb006b2c service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:20.822754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-fc630409-c01d-4d30-8695-f7800457879a None None] MFA Rules not processed for user `f007c4060a55467ba7be187c8d7c0229`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:20.824021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-fc630409-c01d-4d30-8695-f7800457879a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:20.853266 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 896/1768] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 1094 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:20.863479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ed0d-517e-4d95-9d9a-dee351eae9a5 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:20.863769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ed0d-517e-4d95-9d9a-dee351eae9a5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:20.864050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ed0d-517e-4d95-9d9a-dee351eae9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:20.947573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2049ed0d-517e-4d95-9d9a-dee351eae9a5 None None] MFA Rules not processed for user `c9e498e3dae54ffab54d93958bfc2ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:20.948815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2049ed0d-517e-4d95-9d9a-dee351eae9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:21.113564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 873/1769] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:21.114706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc630409-c01d-4d30-8695-f7800457879a None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:21.157900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc630409-c01d-4d30-8695-f7800457879a None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:21.158136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 897/1770] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:21.183019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d0d1e-8a84-4fd6-a292-7af097c2624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:21.187167 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0d1e-8a84-4fd6-a292-7af097c2624f admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:21.189338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0d1e-8a84-4fd6-a292-7af097c2624f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:21.189789 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0d1e-8a84-4fd6-a292-7af097c2624f admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:21.190677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d0d1e-8a84-4fd6-a292-7af097c2624f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:21.199551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d0d1e-8a84-4fd6-a292-7af097c2624f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:21.211100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049ed0d-517e-4d95-9d9a-dee351eae9a5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:21.253825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 874/1771] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:21.254944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d0d1e-8a84-4fd6-a292-7af097c2624f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:21.256251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049ed0d-517e-4d95-9d9a-dee351eae9a5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:21.268827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2002fa-86ee-428c-ad8a-2a1911543d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:21.269561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2002fa-86ee-428c-ad8a-2a1911543d51 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:21.274021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2002fa-86ee-428c-ad8a-2a1911543d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:21.277192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2002fa-86ee-428c-ad8a-2a1911543d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:21.291953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d0d1e-8a84-4fd6-a292-7af097c2624f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:21.307229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39506b-b238-4ba4-8709-2ab31b97868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:21.308157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39506b-b238-4ba4-8709-2ab31b97868c admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:21.308562 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39506b-b238-4ba4-8709-2ab31b97868c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:21.308935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39506b-b238-4ba4-8709-2ab31b97868c admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:21.310463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39506b-b238-4ba4-8709-2ab31b97868c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:21.316078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39506b-b238-4ba4-8709-2ab31b97868c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:21.342719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 875/1772] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:21.343289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2002fa-86ee-428c-ad8a-2a1911543d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:21.347880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2002fa-86ee-428c-ad8a-2a1911543d51 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:21.350572 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39506b-b238-4ba4-8709-2ab31b97868c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:21.382550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39506b-b238-4ba4-8709-2ab31b97868c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:21.403359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 898/1773] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:55:21.429368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33516324-2f1a-4f8a-a0d7-f8946e8fdaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:21.431944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33516324-2f1a-4f8a-a0d7-f8946e8fdaba admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:21.432228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33516324-2f1a-4f8a-a0d7-f8946e8fdaba admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:21.432509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33516324-2f1a-4f8a-a0d7-f8946e8fdaba admin admin] PATH_INFO: `/v3/projects/bd0a4f1546fc48a5983f0a3c5a7cffc5/users/1e26498c2df14c82a48f9ad0eccf5d09/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:21.499367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33516324-2f1a-4f8a-a0d7-f8946e8fdaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0a4f1546fc48a5983f0a3c5a7cffc5, user_id=1e26498c2df14c82a48f9ad0eccf5d09, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:21.503449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33516324-2f1a-4f8a-a0d7-f8946e8fdaba admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:21.536919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 876/1774] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:21 2022] PUT /identity/v3/projects/bd0a4f1546fc48a5983f0a3c5a7cffc5/users/1e26498c2df14c82a48f9ad0eccf5d09/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:21.556815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c4485-eb23-40b3-9abb-e2af012c6e9e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:21.557830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c4485-eb23-40b3-9abb-e2af012c6e9e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:21.558288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c4485-eb23-40b3-9abb-e2af012c6e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:21.623946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-526c4485-eb23-40b3-9abb-e2af012c6e9e None None] MFA Rules not processed for user `1e26498c2df14c82a48f9ad0eccf5d09`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:21.633322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-526c4485-eb23-40b3-9abb-e2af012c6e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:21.893747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33516324-2f1a-4f8a-a0d7-f8946e8fdaba admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:21.898522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-33516324-2f1a-4f8a-a0d7-f8946e8fdaba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:21.999645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 899/1775] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:22.002405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c4485-eb23-40b3-9abb-e2af012c6e9e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:22.203054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33516324-2f1a-4f8a-a0d7-f8946e8fdaba admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:22.225787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518d56-2fb5-4e8a-a857-0c684fb6d067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:22.228893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518d56-2fb5-4e8a-a857-0c684fb6d067 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:22.230820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518d56-2fb5-4e8a-a857-0c684fb6d067 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:22.236072 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b518d56-2fb5-4e8a-a857-0c684fb6d067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:22.250571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7b518d56-2fb5-4e8a-a857-0c684fb6d067 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:22.301762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c4485-eb23-40b3-9abb-e2af012c6e9e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:22.340192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cc126-b3b2-465d-85e8-2956788730b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:22.341091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cc126-b3b2-465d-85e8-2956788730b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:22.345941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cc126-b3b2-465d-85e8-2956788730b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:22.346458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cc126-b3b2-465d-85e8-2956788730b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:22.349109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cc126-b3b2-465d-85e8-2956788730b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:22.357082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cc126-b3b2-465d-85e8-2956788730b9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:22.432793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 900/1776] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:21 2022] POST /identity/v3/projects => generated 369 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:22.438968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cc126-b3b2-465d-85e8-2956788730b9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:22.532276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518d56-2fb5-4e8a-a857-0c684fb6d067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:22.536153 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b518d56-2fb5-4e8a-a857-0c684fb6d067 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:22.588065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 877/1777] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:22.607051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cc126-b3b2-465d-85e8-2956788730b9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:22.617326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75ae80-00ce-471e-9f2e-d4eb559ac9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:22.620454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75ae80-00ce-471e-9f2e-d4eb559ac9bb admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:22.625050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75ae80-00ce-471e-9f2e-d4eb559ac9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:22.626238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75ae80-00ce-471e-9f2e-d4eb559ac9bb admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:22.627650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75ae80-00ce-471e-9f2e-d4eb559ac9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:22.632691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75ae80-00ce-471e-9f2e-d4eb559ac9bb admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:22.720750 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 901/1778] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:22 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:22.724039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518d56-2fb5-4e8a-a857-0c684fb6d067 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:22.749420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b518d56-2fb5-4e8a-a857-0c684fb6d067 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:22.759336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9417c8a-5c20-41bd-b583-b4d12141a20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:22.760505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9417c8a-5c20-41bd-b583-b4d12141a20b admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:22.761620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9417c8a-5c20-41bd-b583-b4d12141a20b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:22.762698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9417c8a-5c20-41bd-b583-b4d12141a20b admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:22.764859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9417c8a-5c20-41bd-b583-b4d12141a20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:22.768343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9417c8a-5c20-41bd-b583-b4d12141a20b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:22.789394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 878/1779] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:22.801531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75ae80-00ce-471e-9f2e-d4eb559ac9bb admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:22.820440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75ae80-00ce-471e-9f2e-d4eb559ac9bb admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:22.829352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c409b-93da-4b6e-a4a6-6ba927943f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:22.830358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c409b-93da-4b6e-a4a6-6ba927943f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:22.830644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c409b-93da-4b6e-a4a6-6ba927943f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:22.830997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c409b-93da-4b6e-a4a6-6ba927943f54 admin admin] PATH_INFO: `/v3/projects/8175e6152f6b4232996e1e3433e339c8/users/6abf0f4afc594eef9ccfbad642c2033a/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:22.886481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c409b-93da-4b6e-a4a6-6ba927943f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8175e6152f6b4232996e1e3433e339c8, user_id=6abf0f4afc594eef9ccfbad642c2033a, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:22.913972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c409b-93da-4b6e-a4a6-6ba927943f54 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:22.917365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220daf5-fa01-4e94-acd1-5841cef07443 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:22.917726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220daf5-fa01-4e94-acd1-5841cef07443 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:22.918017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220daf5-fa01-4e94-acd1-5841cef07443 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:22.921671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 879/1780] 10.222.0.23 () {54 vars in 912 bytes} [Wed Apr 6 12:55:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:55:22.938730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea2023-c7fb-4c3e-a4fc-bbef9c01f502 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:22.939091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea2023-c7fb-4c3e-a4fc-bbef9c01f502 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:22.939433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea2023-c7fb-4c3e-a4fc-bbef9c01f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:22.948161 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 902/1781] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:22 2022] PUT /identity/v3/projects/8175e6152f6b4232996e1e3433e339c8/users/6abf0f4afc594eef9ccfbad642c2033a/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:22.973405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c409b-93da-4b6e-a4a6-6ba927943f54 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:23.013253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c0ea2023-c7fb-4c3e-a4fc-bbef9c01f502 None None] MFA Rules not processed for user `7bd327cdfe2c4f729252d86838aae638`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:23.019461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c0ea2023-c7fb-4c3e-a4fc-bbef9c01f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:23.161208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 880/1782] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 12:55:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:23.166438 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea2023-c7fb-4c3e-a4fc-bbef9c01f502 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:23.172381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c409b-93da-4b6e-a4a6-6ba927943f54 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:23.180550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016688c-a2e0-42e8-9c2f-8451fc9e5e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:23.181711 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016688c-a2e0-42e8-9c2f-8451fc9e5e51 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:23.182227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016688c-a2e0-42e8-9c2f-8451fc9e5e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:23.182735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016688c-a2e0-42e8-9c2f-8451fc9e5e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:23.185523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016688c-a2e0-42e8-9c2f-8451fc9e5e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:23.185790 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea2023-c7fb-4c3e-a4fc-bbef9c01f502 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:23.189108 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016688c-a2e0-42e8-9c2f-8451fc9e5e51 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:23.206149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a160c-5b0b-466d-b0da-7455a5d03000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:23.207018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a160c-5b0b-466d-b0da-7455a5d03000 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:23.207475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a160c-5b0b-466d-b0da-7455a5d03000 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:23.207840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a160c-5b0b-466d-b0da-7455a5d03000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:23.221761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 903/1783] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:23.234299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016688c-a2e0-42e8-9c2f-8451fc9e5e51 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:23.234774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a160c-5b0b-466d-b0da-7455a5d03000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:23.236687 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a160c-5b0b-466d-b0da-7455a5d03000 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:23.249331 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 881/1784] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:55:23.251175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016688c-a2e0-42e8-9c2f-8451fc9e5e51 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:23.257328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cfe7a-a583-4193-aab1-c74e78584df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:23.258285 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfe7a-a583-4193-aab1-c74e78584df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:23.258729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfe7a-a583-4193-aab1-c74e78584df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:23.259151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cfe7a-a583-4193-aab1-c74e78584df4 admin admin] PATH_INFO: `/v3/projects/8175e6152f6b4232996e1e3433e339c8/users/6abf0f4afc594eef9ccfbad642c2033a/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:23.261984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cfe7a-a583-4193-aab1-c74e78584df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8175e6152f6b4232996e1e3433e339c8, user_id=6abf0f4afc594eef9ccfbad642c2033a, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:23.272096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cfe7a-a583-4193-aab1-c74e78584df4 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:23.289628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 904/1785] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:23 2022] PUT /identity/v3/projects/8175e6152f6b4232996e1e3433e339c8/users/6abf0f4afc594eef9ccfbad642c2033a/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:23.302625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9635f-96e2-4a46-9e53-94866d5f03ee None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:23.302903 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9635f-96e2-4a46-9e53-94866d5f03ee None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:23.303179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9635f-96e2-4a46-9e53-94866d5f03ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:23.443678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-a1f9635f-96e2-4a46-9e53-94866d5f03ee None None] MFA Rules not processed for user `6abf0f4afc594eef9ccfbad642c2033a`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:23.451509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a1f9635f-96e2-4a46-9e53-94866d5f03ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:23.656393 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 882/1786] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:23 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:23.667146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cfe7a-a583-4193-aab1-c74e78584df4 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:23.846021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cfe7a-a583-4193-aab1-c74e78584df4 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:23.860552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096d5c0-86de-4d2c-bf5a-dfc67eacb7a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:23.862658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d5c0-86de-4d2c-bf5a-dfc67eacb7a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:23.865141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d5c0-86de-4d2c-bf5a-dfc67eacb7a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:23.865598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096d5c0-86de-4d2c-bf5a-dfc67eacb7a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:23.906907 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d5c0-86de-4d2c-bf5a-dfc67eacb7a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:23.919673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096d5c0-86de-4d2c-bf5a-dfc67eacb7a9 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:23.999251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 905/1787] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:23 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:24.917128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa94cf-79d0-4c3f-b0b3-ea2a49f8e9d4 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:24.917697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa94cf-79d0-4c3f-b0b3-ea2a49f8e9d4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:24.918409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa94cf-79d0-4c3f-b0b3-ea2a49f8e9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:24.960402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f5aa94cf-79d0-4c3f-b0b3-ea2a49f8e9d4 None None] MFA Rules not processed for user `c07f9210231742ffac3dae4b75887d66`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:24.967188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f5aa94cf-79d0-4c3f-b0b3-ea2a49f8e9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:25.047383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7f5b6-48f1-4418-ab65-76da2b4f9873 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:25.048455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7f5b6-48f1-4418-ab65-76da2b4f9873 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:25.048932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7f5b6-48f1-4418-ab65-76da2b4f9873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:25.119185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-8bd7f5b6-48f1-4418-ab65-76da2b4f9873 None None] MFA Rules not processed for user `de5a97c449b9446b959d1ef7b92d5946`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:25.121266 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8bd7f5b6-48f1-4418-ab65-76da2b4f9873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:25.218060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 883/1788] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:25.283532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 906/1789] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:25.293772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa94cf-79d0-4c3f-b0b3-ea2a49f8e9d4 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:25.493526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa94cf-79d0-4c3f-b0b3-ea2a49f8e9d4 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:25.509271 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9104c5e-ed08-4db1-982d-0ba27ffe3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:25.511671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104c5e-ed08-4db1-982d-0ba27ffe3c0c admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:25.516587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104c5e-ed08-4db1-982d-0ba27ffe3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:25.518159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9104c5e-ed08-4db1-982d-0ba27ffe3c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:25.524934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9104c5e-ed08-4db1-982d-0ba27ffe3c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:25.531106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9104c5e-ed08-4db1-982d-0ba27ffe3c0c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:25.708864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 884/1790] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:25 2022] POST /identity/v3/projects => generated 405 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:25.714356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7f5b6-48f1-4418-ab65-76da2b4f9873 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:25.762370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7f5b6-48f1-4418-ab65-76da2b4f9873 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:26.018636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b233a-81d0-4a8d-adaf-ced5134d7038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:26.021736 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b233a-81d0-4a8d-adaf-ced5134d7038 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:26.022268 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b233a-81d0-4a8d-adaf-ced5134d7038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:26.023948 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b233a-81d0-4a8d-adaf-ced5134d7038 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:26.025007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b233a-81d0-4a8d-adaf-ced5134d7038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:26.032966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b233a-81d0-4a8d-adaf-ced5134d7038 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:26.120339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 907/1791] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:25 2022] POST /identity/v3/users => generated 309 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:26.122556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9104c5e-ed08-4db1-982d-0ba27ffe3c0c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:26.187513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9104c5e-ed08-4db1-982d-0ba27ffe3c0c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:26.257620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b36cb4-9bee-4339-923e-88d99c9f0057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:26.258591 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b36cb4-9bee-4339-923e-88d99c9f0057 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:26.258983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b36cb4-9bee-4339-923e-88d99c9f0057 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:26.259268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b36cb4-9bee-4339-923e-88d99c9f0057 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:26.260171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b36cb4-9bee-4339-923e-88d99c9f0057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:26.278138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b36cb4-9bee-4339-923e-88d99c9f0057 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:26.346437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 885/1792] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:26.347349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b233a-81d0-4a8d-adaf-ced5134d7038 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:26.388591 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b233a-81d0-4a8d-adaf-ced5134d7038 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:26.421815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72feeb62-dcc3-4cb3-8387-a95e4fa12727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:26.431051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feeb62-dcc3-4cb3-8387-a95e4fa12727 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:26.432091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feeb62-dcc3-4cb3-8387-a95e4fa12727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:26.432708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72feeb62-dcc3-4cb3-8387-a95e4fa12727 admin admin] PATH_INFO: `/v3/projects/bbd5f5b0ae8e4567a4f30c6a86a5e893/users/cfd64ebc75c641c4aa661aa2bfbbfac9/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:26.466023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72feeb62-dcc3-4cb3-8387-a95e4fa12727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd5f5b0ae8e4567a4f30c6a86a5e893, user_id=cfd64ebc75c641c4aa661aa2bfbbfac9, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:26.469964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72feeb62-dcc3-4cb3-8387-a95e4fa12727 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:26.510484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 908/1793] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:26 2022] PUT /identity/v3/projects/bbd5f5b0ae8e4567a4f30c6a86a5e893/users/cfd64ebc75c641c4aa661aa2bfbbfac9/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:26.515034 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b36cb4-9bee-4339-923e-88d99c9f0057 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:26.534809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b36cb4-9bee-4339-923e-88d99c9f0057 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:26.646110 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72feeb62-dcc3-4cb3-8387-a95e4fa12727 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:26.648048 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-72feeb62-dcc3-4cb3-8387-a95e4fa12727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:26.827198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6960b-57c0-4f9e-a547-dc0fbe80aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:26.828219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6960b-57c0-4f9e-a547-dc0fbe80aad5 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:26.828576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6960b-57c0-4f9e-a547-dc0fbe80aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:26.828885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6960b-57c0-4f9e-a547-dc0fbe80aad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:26.842390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6960b-57c0-4f9e-a547-dc0fbe80aad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:26.846982 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6960b-57c0-4f9e-a547-dc0fbe80aad5 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:26.893157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 886/1794] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:26.895013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6960b-57c0-4f9e-a547-dc0fbe80aad5 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:26.913119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72feeb62-dcc3-4cb3-8387-a95e4fa12727 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:26.936946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6960b-57c0-4f9e-a547-dc0fbe80aad5 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:26.940875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:26.941921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:26.942207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:26.942688 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] PATH_INFO: `/v3/users/db97149b58904bf2911577f3e7218dc3` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:26.948247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db97149b58904bf2911577f3e7218dc3)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:26.952964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:26.966602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21653893-0d20-4ed6-8659-a2d67eb7be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:26.967674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21653893-0d20-4ed6-8659-a2d67eb7be1a admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:26.968007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21653893-0d20-4ed6-8659-a2d67eb7be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:26.968104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21653893-0d20-4ed6-8659-a2d67eb7be1a admin admin] PATH_INFO: `/v3/projects/bbd5f5b0ae8e4567a4f30c6a86a5e893/users/cfd64ebc75c641c4aa661aa2bfbbfac9/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:26.972060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21653893-0d20-4ed6-8659-a2d67eb7be1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbd5f5b0ae8e4567a4f30c6a86a5e893, user_id=cfd64ebc75c641c4aa661aa2bfbbfac9, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:26.974856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21653893-0d20-4ed6-8659-a2d67eb7be1a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:27.014311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 887/1795] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:26 2022] PUT /identity/v3/projects/bbd5f5b0ae8e4567a4f30c6a86a5e893/users/cfd64ebc75c641c4aa661aa2bfbbfac9/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:27.135504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db97149b58904bf2911577f3e7218dc3'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:27.136272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db97149b58904bf2911577f3e7218dc3'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:27.137512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db97149b58904bf2911577f3e7218dc3'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:27.167338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db97149b58904bf2911577f3e7218dc3'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:27.182998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db97149b58904bf2911577f3e7218dc3'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:27.229835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 909/1796] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:26 2022] DELETE /identity/v3/users/db97149b58904bf2911577f3e7218dc3 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:27.234681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b265d-193a-4c2c-b100-f731247093d0 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:27.235660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b265d-193a-4c2c-b100-f731247093d0 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:27.236099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b265d-193a-4c2c-b100-f731247093d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:27.296166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-370b265d-193a-4c2c-b100-f731247093d0 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:27.298831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-370b265d-193a-4c2c-b100-f731247093d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:27.453093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 888/1797] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:27.729549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:27.732070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:27.928481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7468d-6a0e-4bdc-8392-ba0be30c035a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:27.939931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1ba14-c7aa-405b-bcfb-20321a88d912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:27.941566 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ba14-c7aa-405b-bcfb-20321a88d912 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:27.942436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ba14-c7aa-405b-bcfb-20321a88d912 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:27.943137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1ba14-c7aa-405b-bcfb-20321a88d912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:27.967530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ba14-c7aa-405b-bcfb-20321a88d912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:27.970566 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1ba14-c7aa-405b-bcfb-20321a88d912 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:28.001065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 910/1798] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:28.093222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b265d-193a-4c2c-b100-f731247093d0 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:28.096102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-370b265d-193a-4c2c-b100-f731247093d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:28.120278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b265d-193a-4c2c-b100-f731247093d0 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:28.133636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:28.135427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:28.135427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:28.135427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] PATH_INFO: `/v3/users/1e26498c2df14c82a48f9ad0eccf5d09` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:28.136757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e26498c2df14c82a48f9ad0eccf5d09)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:28.139263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:28.255440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e26498c2df14c82a48f9ad0eccf5d09'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:28.256738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e26498c2df14c82a48f9ad0eccf5d09'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:28.264348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e26498c2df14c82a48f9ad0eccf5d09'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:28.287281 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e26498c2df14c82a48f9ad0eccf5d09'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:28.321927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e26498c2df14c82a48f9ad0eccf5d09'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:28.392733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 889/1799] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:28 2022] DELETE /identity/v3/users/1e26498c2df14c82a48f9ad0eccf5d09 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:28.395170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8173-caa6-4c48-9436-d93a84fa5430 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:28.396593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8173-caa6-4c48-9436-d93a84fa5430 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:28.397325 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff8173-caa6-4c48-9436-d93a84fa5430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:28.479491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-63ff8173-caa6-4c48-9436-d93a84fa5430 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:28.483040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-63ff8173-caa6-4c48-9436-d93a84fa5430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:28.661021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 911/1800] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:28.675202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:28.677277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:28.777038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1c15c-70e3-49e8-b209-1a296da111d6 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:28.782159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228bb46-6ff2-47e3-9146-3aa3dcc23f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:28.782947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228bb46-6ff2-47e3-9146-3aa3dcc23f11 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:28.783301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228bb46-6ff2-47e3-9146-3aa3dcc23f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:28.783664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228bb46-6ff2-47e3-9146-3aa3dcc23f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:28.797228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228bb46-6ff2-47e3-9146-3aa3dcc23f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:28.798780 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228bb46-6ff2-47e3-9146-3aa3dcc23f11 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:28.811012 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 890/1801] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:29.073718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff8173-caa6-4c48-9436-d93a84fa5430 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:29.076676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-63ff8173-caa6-4c48-9436-d93a84fa5430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:29.105921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff8173-caa6-4c48-9436-d93a84fa5430 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:29.115539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:29.117030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:29.117513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:29.118286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] PATH_INFO: `/v3/projects/fd76c21582644d5ab809d21ae50a7c8f` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:29.120544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd76c21582644d5ab809d21ae50a7c8f)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:29.125362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:29.145256 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228bb46-6ff2-47e3-9146-3aa3dcc23f11 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:29.148449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0228bb46-6ff2-47e3-9146-3aa3dcc23f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:29.179280 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228bb46-6ff2-47e3-9146-3aa3dcc23f11 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:29.193228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:29.194604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:29.195095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:29.195737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] PATH_INFO: `/v3/projects/bd0a4f1546fc48a5983f0a3c5a7cffc5` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:29.197878 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0a4f1546fc48a5983f0a3c5a7cffc5)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:29.200689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:29.224843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd76c21582644d5ab809d21ae50a7c8f', 'request_id': 'req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.239731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd76c21582644d5ab809d21ae50a7c8f', 'request_id': 'req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.250835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd76c21582644d5ab809d21ae50a7c8f', 'request_id': 'req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.276553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] The token cache is being invalidate because project fd76c21582644d5ab809d21ae50a7c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:29.277274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.279940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cf7301ce-c89d-4c93-a9c9-1b7e599207ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.283181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 912/1802] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:29 2022] DELETE /identity/v3/projects/fd76c21582644d5ab809d21ae50a7c8f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:29.287381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfadb8-1fdb-41e4-abca-2bff070d364f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:29.287381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfadb8-1fdb-41e4-abca-2bff070d364f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:29.287855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfadb8-1fdb-41e4-abca-2bff070d364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:29.309599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0a4f1546fc48a5983f0a3c5a7cffc5', 'request_id': 'req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.317719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0a4f1546fc48a5983f0a3c5a7cffc5', 'request_id': 'req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.331909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0a4f1546fc48a5983f0a3c5a7cffc5', 'request_id': 'req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.337321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-91cfadb8-1fdb-41e4-abca-2bff070d364f None None] MFA Rules not processed for user `cfd64ebc75c641c4aa661aa2bfbbfac9`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:29.339262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-91cfadb8-1fdb-41e4-abca-2bff070d364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:29.349362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] The token cache is being invalidate because project bd0a4f1546fc48a5983f0a3c5a7cffc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:29.349907 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.351017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.354523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 891/1803] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:29 2022] DELETE /identity/v3/projects/bd0a4f1546fc48a5983f0a3c5a7cffc5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:29.356545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:29.359947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:29.447927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84054367-eb0f-4d8e-9170-e45b4e0b4d0f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:29.455225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:29.456693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:29.457193 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:29.457867 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] PATH_INFO: `/v3/users/bfd8f2e6d80a40288a1f0aba1898b721` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:29.459747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd8f2e6d80a40288a1f0aba1898b721)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:29.459971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 913/1804] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:29.460994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfadb8-1fdb-41e4-abca-2bff070d364f None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:29.462262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:29.462938 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-91cfadb8-1fdb-41e4-abca-2bff070d364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:29.498663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfadb8-1fdb-41e4-abca-2bff070d364f None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:29.505329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:29.506640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:29.507165 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:29.507639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] PATH_INFO: `/v3/users/6abf0f4afc594eef9ccfbad642c2033a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:29.509667 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6abf0f4afc594eef9ccfbad642c2033a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:29.514035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:29.534376 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd8f2e6d80a40288a1f0aba1898b721'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.535214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd8f2e6d80a40288a1f0aba1898b721'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.535834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd8f2e6d80a40288a1f0aba1898b721'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.543941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd8f2e6d80a40288a1f0aba1898b721'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.560139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd8f2e6d80a40288a1f0aba1898b721'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.575938 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 892/1805] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:29 2022] DELETE /identity/v3/users/bfd8f2e6d80a40288a1f0aba1898b721 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:29.581943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6abf0f4afc594eef9ccfbad642c2033a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.582699 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6abf0f4afc594eef9ccfbad642c2033a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.584120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6abf0f4afc594eef9ccfbad642c2033a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.607586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6abf0f4afc594eef9ccfbad642c2033a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.621427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4e5914a-ba51-4d60-adc5-1ad250a13c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6abf0f4afc594eef9ccfbad642c2033a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:29.637231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 914/1806] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:29 2022] DELETE /identity/v3/users/6abf0f4afc594eef9ccfbad642c2033a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:30.378954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:30.381243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:30.487833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db97cf-cc93-4e7a-b73c-aea5a0b9473f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:30.557133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:30.558262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:30.561016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:30.561785 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] PATH_INFO: `/v3/projects/589e4844a96740749c9c2013f8b54d52` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:30.564343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=589e4844a96740749c9c2013f8b54d52)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:30.567805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:30.632347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589e4844a96740749c9c2013f8b54d52', 'request_id': 'req-39291573-54fd-4854-a69d-6a7c2f3d6927'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:30.641378 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589e4844a96740749c9c2013f8b54d52', 'request_id': 'req-39291573-54fd-4854-a69d-6a7c2f3d6927'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:30.652564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589e4844a96740749c9c2013f8b54d52', 'request_id': 'req-39291573-54fd-4854-a69d-6a7c2f3d6927'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:30.675370 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] The token cache is being invalidate because project 589e4844a96740749c9c2013f8b54d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:30.675864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:30.676929 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-39291573-54fd-4854-a69d-6a7c2f3d6927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:30.683494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 893/1807] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:30 2022] DELETE /identity/v3/projects/589e4844a96740749c9c2013f8b54d52 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:30.694396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6622f-bf03-496e-b96c-be5e12867b61 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:30.697420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6622f-bf03-496e-b96c-be5e12867b61 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:30.701101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6622f-bf03-496e-b96c-be5e12867b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:30.737414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-a7a6622f-bf03-496e-b96c-be5e12867b61 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:30.739121 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a7a6622f-bf03-496e-b96c-be5e12867b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:30.829640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 915/1808] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:30.839243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e30d-ed5f-47ae-8577-1d20a5c8afa4 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:30.839530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e30d-ed5f-47ae-8577-1d20a5c8afa4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:30.839956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e30d-ed5f-47ae-8577-1d20a5c8afa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:30.864426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-8286e30d-ed5f-47ae-8577-1d20a5c8afa4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:30.865856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8286e30d-ed5f-47ae-8577-1d20a5c8afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:30.877527 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 894/1809] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:30.882896 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6622f-bf03-496e-b96c-be5e12867b61 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:30.902220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6622f-bf03-496e-b96c-be5e12867b61 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:30.911381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb755151-31bf-4672-ac0d-5813d8e0b5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:30.912494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755151-31bf-4672-ac0d-5813d8e0b5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:30.912927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755151-31bf-4672-ac0d-5813d8e0b5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:30.913493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb755151-31bf-4672-ac0d-5813d8e0b5b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:30.915953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb755151-31bf-4672-ac0d-5813d8e0b5b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:30.916375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb755151-31bf-4672-ac0d-5813d8e0b5b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:30.920094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb755151-31bf-4672-ac0d-5813d8e0b5b4 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:30.937854 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e30d-ed5f-47ae-8577-1d20a5c8afa4 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:30.939642 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8286e30d-ed5f-47ae-8577-1d20a5c8afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:30.959871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 916/1810] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:30.970599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e30d-ed5f-47ae-8577-1d20a5c8afa4 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:30.980041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:30.982180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:30.983098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb755151-31bf-4672-ac0d-5813d8e0b5b4 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:30.984208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:30.984958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] PATH_INFO: `/v3/projects/8175e6152f6b4232996e1e3433e339c8` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:30.996366 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8175e6152f6b4232996e1e3433e339c8)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.000421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.001231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb755151-31bf-4672-ac0d-5813d8e0b5b4 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.017371 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858509c-3c9b-44c4-a45d-de177e2dce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.018178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858509c-3c9b-44c4-a45d-de177e2dce64 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.018470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858509c-3c9b-44c4-a45d-de177e2dce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.020336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858509c-3c9b-44c4-a45d-de177e2dce64 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.021143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858509c-3c9b-44c4-a45d-de177e2dce64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.023516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858509c-3c9b-44c4-a45d-de177e2dce64 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.078005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 917/1811] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:30 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:31.079687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858509c-3c9b-44c4-a45d-de177e2dce64 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.087677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8175e6152f6b4232996e1e3433e339c8', 'request_id': 'req-4e6065ed-5b51-4d50-a179-ebae777731b6'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:31.106294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8175e6152f6b4232996e1e3433e339c8', 'request_id': 'req-4e6065ed-5b51-4d50-a179-ebae777731b6'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:31.123989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8175e6152f6b4232996e1e3433e339c8', 'request_id': 'req-4e6065ed-5b51-4d50-a179-ebae777731b6'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:31.139233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] The token cache is being invalidate because project 8175e6152f6b4232996e1e3433e339c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:31.139589 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:31.140490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4e6065ed-5b51-4d50-a179-ebae777731b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:31.142374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 895/1812] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:30 2022] DELETE /identity/v3/projects/8175e6152f6b4232996e1e3433e339c8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:31.147561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f98fc-e38e-4fd2-a1a9-fe398a551d8d None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.148062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f98fc-e38e-4fd2-a1a9-fe398a551d8d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.148557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f98fc-e38e-4fd2-a1a9-fe398a551d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.171179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3a6f98fc-e38e-4fd2-a1a9-fe398a551d8d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:31.172861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3a6f98fc-e38e-4fd2-a1a9-fe398a551d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:31.205327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858509c-3c9b-44c4-a45d-de177e2dce64 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.265517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 896/1813] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:31.273736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ab8e-5cca-4e63-afad-56e7b4aa6bec None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.274175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ab8e-5cca-4e63-afad-56e7b4aa6bec None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.274513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5ab8e-5cca-4e63-afad-56e7b4aa6bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.298208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f5c5ab8e-5cca-4e63-afad-56e7b4aa6bec None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:31.299670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f5c5ab8e-5cca-4e63-afad-56e7b4aa6bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:31.316675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 897/1814] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:55:31.325388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5ab8e-5cca-4e63-afad-56e7b4aa6bec None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.346469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5ab8e-5cca-4e63-afad-56e7b4aa6bec None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.361539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea7b8e-6076-4e34-a09a-980fc2b02d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.363109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea7b8e-6076-4e34-a09a-980fc2b02d1e admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.363404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea7b8e-6076-4e34-a09a-980fc2b02d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.363837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea7b8e-6076-4e34-a09a-980fc2b02d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.369647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea7b8e-6076-4e34-a09a-980fc2b02d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:31.370207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea7b8e-6076-4e34-a09a-980fc2b02d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.372779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566133e-2bf3-456d-b51b-c39df5bbfc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.373457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea7b8e-6076-4e34-a09a-980fc2b02d1e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.373595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566133e-2bf3-456d-b51b-c39df5bbfc28 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.374072 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566133e-2bf3-456d-b51b-c39df5bbfc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.374358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566133e-2bf3-456d-b51b-c39df5bbfc28 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.375285 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566133e-2bf3-456d-b51b-c39df5bbfc28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.378191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566133e-2bf3-456d-b51b-c39df5bbfc28 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.402207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 898/1815] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:31.404260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea7b8e-6076-4e34-a09a-980fc2b02d1e admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.418176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea7b8e-6076-4e34-a09a-980fc2b02d1e admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.428353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 918/1816] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:31 2022] POST /identity/v3/users => generated 294 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:31.435040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566133e-2bf3-456d-b51b-c39df5bbfc28 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.437070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4566133e-2bf3-456d-b51b-c39df5bbfc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:31.438463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d7ce-6a63-4de7-9ae7-585a5fa878e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.439155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d7ce-6a63-4de7-9ae7-585a5fa878e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.439445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d7ce-6a63-4de7-9ae7-585a5fa878e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.439721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d7ce-6a63-4de7-9ae7-585a5fa878e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.440430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d7ce-6a63-4de7-9ae7-585a5fa878e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.444403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d7ce-6a63-4de7-9ae7-585a5fa878e8 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.456237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566133e-2bf3-456d-b51b-c39df5bbfc28 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.471718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b06fd-5566-43c0-99fc-2c4bb6238985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.472383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b06fd-5566-43c0-99fc-2c4bb6238985 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.472732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b06fd-5566-43c0-99fc-2c4bb6238985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.473232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b06fd-5566-43c0-99fc-2c4bb6238985 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.474374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b06fd-5566-43c0-99fc-2c4bb6238985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.476274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b06fd-5566-43c0-99fc-2c4bb6238985 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.493117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 919/1817] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:31.500046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b06fd-5566-43c0-99fc-2c4bb6238985 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.501888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 899/1818] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:31 2022] POST /identity/v3/projects => generated 407 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:31.510351 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d7ce-6a63-4de7-9ae7-585a5fa878e8 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.520539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b06fd-5566-43c0-99fc-2c4bb6238985 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.626312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d7ce-6a63-4de7-9ae7-585a5fa878e8 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.632376 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec5a20-2621-4c0c-800d-0799fffb1d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.633201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec5a20-2621-4c0c-800d-0799fffb1d00 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.633544 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec5a20-2621-4c0c-800d-0799fffb1d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.634054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec5a20-2621-4c0c-800d-0799fffb1d00 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.634894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec5a20-2621-4c0c-800d-0799fffb1d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.637416 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec5a20-2621-4c0c-800d-0799fffb1d00 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.643348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f427-ae74-4648-bc9a-af4dbeb033d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.644048 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f427-ae74-4648-bc9a-af4dbeb033d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.644339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f427-ae74-4648-bc9a-af4dbeb033d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.644739 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f427-ae74-4648-bc9a-af4dbeb033d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.645517 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496f427-ae74-4648-bc9a-af4dbeb033d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.647866 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496f427-ae74-4648-bc9a-af4dbeb033d0 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.666282 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 920/1819] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:31.667678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f427-ae74-4648-bc9a-af4dbeb033d0 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.673805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 900/1820] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:31 2022] POST /identity/v3/users => generated 304 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:31.675217 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec5a20-2621-4c0c-800d-0799fffb1d00 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.682905 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f427-ae74-4648-bc9a-af4dbeb033d0 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.689973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07964367-4c37-46bc-ae99-f3f413b5884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.690956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07964367-4c37-46bc-ae99-f3f413b5884c admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.691249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec5a20-2621-4c0c-800d-0799fffb1d00 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.691368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07964367-4c37-46bc-ae99-f3f413b5884c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.691684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07964367-4c37-46bc-ae99-f3f413b5884c admin admin] PATH_INFO: `/v3/projects/e42cff09eda44fc68ec1938e19a21ed6/users/73f157e422134f72b196079c125adbf8/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.697459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4a03-ab8b-4769-96ff-541ed0e115aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.698425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4a03-ab8b-4769-96ff-541ed0e115aa admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.698830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4a03-ab8b-4769-96ff-541ed0e115aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.700147 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d4a03-ab8b-4769-96ff-541ed0e115aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.701657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d4a03-ab8b-4769-96ff-541ed0e115aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.703560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d4a03-ab8b-4769-96ff-541ed0e115aa admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.709236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07964367-4c37-46bc-ae99-f3f413b5884c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42cff09eda44fc68ec1938e19a21ed6, user_id=73f157e422134f72b196079c125adbf8, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.712625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07964367-4c37-46bc-ae99-f3f413b5884c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.721029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 901/1821] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:31.722468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4a03-ab8b-4769-96ff-541ed0e115aa admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.732451 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 921/1822] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:31 2022] PUT /identity/v3/projects/e42cff09eda44fc68ec1938e19a21ed6/users/73f157e422134f72b196079c125adbf8/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:55:31.742598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9a29-2911-4ec7-bd52-3c9bcbf6891f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.743239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9a29-2911-4ec7-bd52-3c9bcbf6891f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.743595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b9a29-2911-4ec7-bd52-3c9bcbf6891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.748021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d4a03-ab8b-4769-96ff-541ed0e115aa admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.784044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-558b9a29-2911-4ec7-bd52-3c9bcbf6891f None None] MFA Rules not processed for user `73f157e422134f72b196079c125adbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:31.786061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-558b9a29-2911-4ec7-bd52-3c9bcbf6891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:31.852398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d4f5d-a57b-438f-ba55-6f699ba25814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.853111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d4f5d-a57b-438f-ba55-6f699ba25814 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.853555 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d4f5d-a57b-438f-ba55-6f699ba25814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.853976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d4f5d-a57b-438f-ba55-6f699ba25814 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.854856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d4f5d-a57b-438f-ba55-6f699ba25814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.857768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d4f5d-a57b-438f-ba55-6f699ba25814 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.870077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 902/1823] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:31.870766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 922/1824] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:31.875730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b9a29-2911-4ec7-bd52-3c9bcbf6891f None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.875924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d4f5d-a57b-438f-ba55-6f699ba25814 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.889187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d4f5d-a57b-438f-ba55-6f699ba25814 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.890756 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b9a29-2911-4ec7-bd52-3c9bcbf6891f None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:31.895008 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e55c0-08c4-45ee-8d98-c8db3f28bde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.895953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e55c0-08c4-45ee-8d98-c8db3f28bde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.896227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e55c0-08c4-45ee-8d98-c8db3f28bde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.896559 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e55c0-08c4-45ee-8d98-c8db3f28bde3 admin admin] PATH_INFO: `/v3/projects/180ef56eaf7949388e8f1f9077ec6842/users/96eb2c2cbe4d4af89b6d54b07d3e09d3/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.897310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ab18e-39b6-47c3-9b85-ad6a1b284ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:31.898517 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ab18e-39b6-47c3-9b85-ad6a1b284ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.898819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ab18e-39b6-47c3-9b85-ad6a1b284ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.899156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ab18e-39b6-47c3-9b85-ad6a1b284ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:31.900136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ab18e-39b6-47c3-9b85-ad6a1b284ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.904395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ab18e-39b6-47c3-9b85-ad6a1b284ba6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.943490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 923/1825] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:31 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:31.944698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e55c0-08c4-45ee-8d98-c8db3f28bde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180ef56eaf7949388e8f1f9077ec6842, user_id=96eb2c2cbe4d4af89b6d54b07d3e09d3, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:31.947423 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ab18e-39b6-47c3-9b85-ad6a1b284ba6 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:31.949966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e55c0-08c4-45ee-8d98-c8db3f28bde3 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:31.968218 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 903/1826] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:31 2022] PUT /identity/v3/projects/180ef56eaf7949388e8f1f9077ec6842/users/96eb2c2cbe4d4af89b6d54b07d3e09d3/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:31.979502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571c29-6d06-4d3c-aa2f-83367be3b740 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:31.980782 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571c29-6d06-4d3c-aa2f-83367be3b740 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:31.982205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571c29-6d06-4d3c-aa2f-83367be3b740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.031501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-6c571c29-6d06-4d3c-aa2f-83367be3b740 None None] MFA Rules not processed for user `96eb2c2cbe4d4af89b6d54b07d3e09d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:32.032850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6c571c29-6d06-4d3c-aa2f-83367be3b740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:32.075811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ab18e-39b6-47c3-9b85-ad6a1b284ba6 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.186296 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 904/1827] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:32.188884 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c571c29-6d06-4d3c-aa2f-83367be3b740 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.192941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6c571c29-6d06-4d3c-aa2f-83367be3b740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:32.202592 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e104cf-ddcb-4d55-a201-7f5b6310a61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.203370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e104cf-ddcb-4d55-a201-7f5b6310a61f admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.203654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e104cf-ddcb-4d55-a201-7f5b6310a61f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.204086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e104cf-ddcb-4d55-a201-7f5b6310a61f admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.206477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e104cf-ddcb-4d55-a201-7f5b6310a61f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.207237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e104cf-ddcb-4d55-a201-7f5b6310a61f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.257894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 924/1828] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:31 2022] POST /identity/v3/users => generated 299 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:32.258991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e104cf-ddcb-4d55-a201-7f5b6310a61f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.278941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e104cf-ddcb-4d55-a201-7f5b6310a61f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.288428 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001e59-cada-4ca4-810d-d60494c6e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.289277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001e59-cada-4ca4-810d-d60494c6e466 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.289710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001e59-cada-4ca4-810d-d60494c6e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.290094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19001e59-cada-4ca4-810d-d60494c6e466 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.290919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001e59-cada-4ca4-810d-d60494c6e466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.292972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19001e59-cada-4ca4-810d-d60494c6e466 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.319370 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c571c29-6d06-4d3c-aa2f-83367be3b740 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.329952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.331093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 925/1829] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:32 2022] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:32.332799 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001e59-cada-4ca4-810d-d60494c6e466 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.335019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.335568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.336017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] PATH_INFO: `/v3/users/de5a97c449b9446b959d1ef7b92d5946` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.337502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5a97c449b9446b959d1ef7b92d5946)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.340908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.406018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5a97c449b9446b959d1ef7b92d5946'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:32.406824 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5a97c449b9446b959d1ef7b92d5946'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:32.407566 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5a97c449b9446b959d1ef7b92d5946'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:32.415166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19001e59-cada-4ca4-810d-d60494c6e466 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.416121 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5a97c449b9446b959d1ef7b92d5946'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:32.423813 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d4ac1-68b2-4dd6-b3b9-132df5711c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.424983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4ac1-68b2-4dd6-b3b9-132df5711c8a admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.425459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4ac1-68b2-4dd6-b3b9-132df5711c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.425908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4ac1-68b2-4dd6-b3b9-132df5711c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.426859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d4ac1-68b2-4dd6-b3b9-132df5711c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.428875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d4ac1-68b2-4dd6-b3b9-132df5711c8a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.431853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5a97c449b9446b959d1ef7b92d5946'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:32.442613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 926/1830] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:32.443800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d4ac1-68b2-4dd6-b3b9-132df5711c8a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.446267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f36d4ac1-68b2-4dd6-b3b9-132df5711c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:32.447277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 905/1831] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:32 2022] DELETE /identity/v3/users/de5a97c449b9446b959d1ef7b92d5946 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:32.448166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.450127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:32.469344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d4ac1-68b2-4dd6-b3b9-132df5711c8a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.537872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb921f0-ba2f-483a-a5f9-44e3af5ea028 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.544687 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddc8b0-90dc-4933-8e7a-d9e3f32aaa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.545646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddc8b0-90dc-4933-8e7a-d9e3f32aaa2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.545929 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddc8b0-90dc-4933-8e7a-d9e3f32aaa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.546206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddc8b0-90dc-4933-8e7a-d9e3f32aaa2c admin admin] PATH_INFO: `/v3/projects/d0b4a70d74dd48beb9be65f366b71156/users/55b2e627f2cc4d8ca66b4e9125090b08/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.563421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddc8b0-90dc-4933-8e7a-d9e3f32aaa2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b4a70d74dd48beb9be65f366b71156, user_id=55b2e627f2cc4d8ca66b4e9125090b08, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.566755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddc8b0-90dc-4933-8e7a-d9e3f32aaa2c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.582362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6aa5-2241-4d12-8bca-cd123903519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.583566 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6aa5-2241-4d12-8bca-cd123903519f admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.584061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6aa5-2241-4d12-8bca-cd123903519f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.584313 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 906/1832] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:32 2022] PUT /identity/v3/projects/d0b4a70d74dd48beb9be65f366b71156/users/55b2e627f2cc4d8ca66b4e9125090b08/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:32.585238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a6aa5-2241-4d12-8bca-cd123903519f admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.586184 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a6aa5-2241-4d12-8bca-cd123903519f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.588846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddc8b0-90dc-4933-8e7a-d9e3f32aaa2c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.592320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a6aa5-2241-4d12-8bca-cd123903519f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.629627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 927/1833] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:32 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:32.632427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6aa5-2241-4d12-8bca-cd123903519f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.644765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a6aa5-2241-4d12-8bca-cd123903519f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.679289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddc8b0-90dc-4933-8e7a-d9e3f32aaa2c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.685672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d322240-1671-4d5f-869d-a399f6042cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.686879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d322240-1671-4d5f-869d-a399f6042cdf admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.687140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d322240-1671-4d5f-869d-a399f6042cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.687420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d322240-1671-4d5f-869d-a399f6042cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.688165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d322240-1671-4d5f-869d-a399f6042cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.689847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d322240-1671-4d5f-869d-a399f6042cdf admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.705990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 907/1834] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:55:32.706980 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d322240-1671-4d5f-869d-a399f6042cdf admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.709292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7d322240-1671-4d5f-869d-a399f6042cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:32.725473 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d322240-1671-4d5f-869d-a399f6042cdf admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.731471 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.732434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.732725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.733042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] PATH_INFO: `/v3/projects/113ad226f00d467b880c2d6312b83be6` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.734413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=113ad226f00d467b880c2d6312b83be6)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.736422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.750370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d49cf-41a4-40d9-b399-73d6466fd486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.751108 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d49cf-41a4-40d9-b399-73d6466fd486 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.751380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d49cf-41a4-40d9-b399-73d6466fd486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.751665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d49cf-41a4-40d9-b399-73d6466fd486 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.752405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d49cf-41a4-40d9-b399-73d6466fd486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.754091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d49cf-41a4-40d9-b399-73d6466fd486 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.768462 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 928/1835] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:55:32.768462 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d49cf-41a4-40d9-b399-73d6466fd486 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.776766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d49cf-41a4-40d9-b399-73d6466fd486 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.782323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10796d64-f03b-4545-bbce-61e3705ed490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.783558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10796d64-f03b-4545-bbce-61e3705ed490 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.784198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10796d64-f03b-4545-bbce-61e3705ed490 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.784198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10796d64-f03b-4545-bbce-61e3705ed490 admin admin] PATH_INFO: `/v3/projects/d0b4a70d74dd48beb9be65f366b71156/users/55b2e627f2cc4d8ca66b4e9125090b08/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.786624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10796d64-f03b-4545-bbce-61e3705ed490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0b4a70d74dd48beb9be65f366b71156, user_id=55b2e627f2cc4d8ca66b4e9125090b08, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.789377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10796d64-f03b-4545-bbce-61e3705ed490 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.796356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113ad226f00d467b880c2d6312b83be6', 'request_id': 'req-6862c55a-90f7-4122-b4fe-fae98738ce19'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:32.803587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 929/1836] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:32 2022] PUT /identity/v3/projects/d0b4a70d74dd48beb9be65f366b71156/users/55b2e627f2cc4d8ca66b4e9125090b08/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:32.813395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113ad226f00d467b880c2d6312b83be6', 'request_id': 'req-6862c55a-90f7-4122-b4fe-fae98738ce19'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:32.813550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10796d64-f03b-4545-bbce-61e3705ed490 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.815656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113ad226f00d467b880c2d6312b83be6', 'request_id': 'req-6862c55a-90f7-4122-b4fe-fae98738ce19'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:32.830339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] The token cache is being invalidate because project 113ad226f00d467b880c2d6312b83be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:32.830660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:32.831341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6862c55a-90f7-4122-b4fe-fae98738ce19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:32.832979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 908/1837] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:32 2022] DELETE /identity/v3/projects/113ad226f00d467b880c2d6312b83be6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:32.834398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328205a1-b9b2-4c82-9cd7-974e1609c4b9 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.834808 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328205a1-b9b2-4c82-9cd7-974e1609c4b9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.834961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328205a1-b9b2-4c82-9cd7-974e1609c4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.867128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-328205a1-b9b2-4c82-9cd7-974e1609c4b9 None None] MFA Rules not processed for user `55b2e627f2cc4d8ca66b4e9125090b08`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:32.868829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-328205a1-b9b2-4c82-9cd7-974e1609c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:32.883013 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10796d64-f03b-4545-bbce-61e3705ed490 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:32.888063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24c96d-32c5-4cae-be4c-7b1eb262d158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:32.888974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24c96d-32c5-4cae-be4c-7b1eb262d158 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:32.889257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24c96d-32c5-4cae-be4c-7b1eb262d158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:32.889528 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24c96d-32c5-4cae-be4c-7b1eb262d158 admin admin] PATH_INFO: `/v3/projects/ff18ed419609462b9d7ed757b8ff9b14/users/4a0b2f2c22ad413a995476d130ebd7f4/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:32.906014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24c96d-32c5-4cae-be4c-7b1eb262d158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff18ed419609462b9d7ed757b8ff9b14, user_id=4a0b2f2c22ad413a995476d130ebd7f4, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:32.908821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a24c96d-32c5-4cae-be4c-7b1eb262d158 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:32.926269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 930/1838] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:32 2022] PUT /identity/v3/projects/ff18ed419609462b9d7ed757b8ff9b14/users/4a0b2f2c22ad413a995476d130ebd7f4/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:32.927019 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24c96d-32c5-4cae-be4c-7b1eb262d158 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.931438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7a24c96d-32c5-4cae-be4c-7b1eb262d158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:32.947354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 909/1839] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:32.948293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328205a1-b9b2-4c82-9cd7-974e1609c4b9 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:32.949876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-328205a1-b9b2-4c82-9cd7-974e1609c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:32.963960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328205a1-b9b2-4c82-9cd7-974e1609c4b9 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:33.009648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24c96d-32c5-4cae-be4c-7b1eb262d158 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:33.016678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:33.017654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:33.017894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:33.018162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] PATH_INFO: `/v3/users/cfd64ebc75c641c4aa661aa2bfbbfac9` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:33.019460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd64ebc75c641c4aa661aa2bfbbfac9)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:33.021677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:33.046974 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5664ac3-3c13-4121-8cfe-b6bd4ad757fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:33.047672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5664ac3-3c13-4121-8cfe-b6bd4ad757fb admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:33.047960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5664ac3-3c13-4121-8cfe-b6bd4ad757fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:33.048238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5664ac3-3c13-4121-8cfe-b6bd4ad757fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:33.048997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5664ac3-3c13-4121-8cfe-b6bd4ad757fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:33.050889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5664ac3-3c13-4121-8cfe-b6bd4ad757fb admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:33.069847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 910/1840] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:33.069847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5664ac3-3c13-4121-8cfe-b6bd4ad757fb admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:33.069847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d5664ac3-3c13-4121-8cfe-b6bd4ad757fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:33.102263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd64ebc75c641c4aa661aa2bfbbfac9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.103133 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd64ebc75c641c4aa661aa2bfbbfac9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.103849 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd64ebc75c641c4aa661aa2bfbbfac9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.120475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd64ebc75c641c4aa661aa2bfbbfac9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.132313 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd64ebc75c641c4aa661aa2bfbbfac9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.155298 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 931/1841] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:32 2022] DELETE /identity/v3/users/cfd64ebc75c641c4aa661aa2bfbbfac9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:33.159746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:33.161338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:33.169014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5664ac3-3c13-4121-8cfe-b6bd4ad757fb admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:33.239624 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704137-4b25-4d70-acba-9ac40b7464e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:33.240509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704137-4b25-4d70-acba-9ac40b7464e6 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:33.240897 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704137-4b25-4d70-acba-9ac40b7464e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:33.241383 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a704137-4b25-4d70-acba-9ac40b7464e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:33.243827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0a704137-4b25-4d70-acba-9ac40b7464e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:33.262855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036c3f9-ed3e-407f-9bca-c3eb3f47c1b4 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:33.271327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cc528-8791-4766-a0ea-935053cdc64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:33.273204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cc528-8791-4766-a0ea-935053cdc64f admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:33.274737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cc528-8791-4766-a0ea-935053cdc64f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:33.274737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cc528-8791-4766-a0ea-935053cdc64f admin admin] PATH_INFO: `/v3/projects/ff18ed419609462b9d7ed757b8ff9b14/users/4a0b2f2c22ad413a995476d130ebd7f4/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:33.281398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cc528-8791-4766-a0ea-935053cdc64f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff18ed419609462b9d7ed757b8ff9b14, user_id=4a0b2f2c22ad413a995476d130ebd7f4, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:33.304281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cc528-8791-4766-a0ea-935053cdc64f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:33.348631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 932/1842] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:33 2022] PUT /identity/v3/projects/ff18ed419609462b9d7ed757b8ff9b14/users/4a0b2f2c22ad413a995476d130ebd7f4/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:33.373821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201c9c-5f13-4356-952f-4314067d9232 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:33.374414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201c9c-5f13-4356-952f-4314067d9232 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:33.374703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19201c9c-5f13-4356-952f-4314067d9232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:33.423554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a704137-4b25-4d70-acba-9ac40b7464e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:33.429283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a704137-4b25-4d70-acba-9ac40b7464e6 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:33.431637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-19201c9c-5f13-4356-952f-4314067d9232 None None] MFA Rules not processed for user `4a0b2f2c22ad413a995476d130ebd7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:33.435676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-19201c9c-5f13-4356-952f-4314067d9232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:33.463500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 911/1843] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:33.574381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704137-4b25-4d70-acba-9ac40b7464e6 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:33.576609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0a704137-4b25-4d70-acba-9ac40b7464e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:33.587496 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 933/1844] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:55:33.590652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201c9c-5f13-4356-952f-4314067d9232 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:33.593902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a704137-4b25-4d70-acba-9ac40b7464e6 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:33.594498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-19201c9c-5f13-4356-952f-4314067d9232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:33.672731 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:33.673800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:33.674197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:33.674581 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] PATH_INFO: `/v3/users/73f157e422134f72b196079c125adbf8` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:33.676158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f157e422134f72b196079c125adbf8)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:33.678349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:33.708866 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19201c9c-5f13-4356-952f-4314067d9232 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:33.718235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:33.719576 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:33.719977 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:33.720429 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] PATH_INFO: `/v3/projects/bbd5f5b0ae8e4567a4f30c6a86a5e893` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:33.722812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbd5f5b0ae8e4567a4f30c6a86a5e893)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:33.725748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:33.739551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f157e422134f72b196079c125adbf8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.740224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f157e422134f72b196079c125adbf8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.741088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f157e422134f72b196079c125adbf8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.748848 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f157e422134f72b196079c125adbf8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.761415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f157e422134f72b196079c125adbf8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.785804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 912/1845] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:33 2022] DELETE /identity/v3/users/73f157e422134f72b196079c125adbf8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:33.785804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:33.786651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:33.790788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbd5f5b0ae8e4567a4f30c6a86a5e893', 'request_id': 'req-16152cd4-3dfd-4289-b67d-52d22a1f796e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.798243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbd5f5b0ae8e4567a4f30c6a86a5e893', 'request_id': 'req-16152cd4-3dfd-4289-b67d-52d22a1f796e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.806682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbd5f5b0ae8e4567a4f30c6a86a5e893', 'request_id': 'req-16152cd4-3dfd-4289-b67d-52d22a1f796e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.821987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] The token cache is being invalidate because project bbd5f5b0ae8e4567a4f30c6a86a5e893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:33.822481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.823595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-16152cd4-3dfd-4289-b67d-52d22a1f796e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:33.827077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 934/1846] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:33 2022] DELETE /identity/v3/projects/bbd5f5b0ae8e4567a4f30c6a86a5e893 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:33.833398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814d43-0f2b-4e7b-856b-8871e6b1ed30 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:33.833608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814d43-0f2b-4e7b-856b-8871e6b1ed30 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:33.833970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814d43-0f2b-4e7b-856b-8871e6b1ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:33.862243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-c3814d43-0f2b-4e7b-856b-8871e6b1ed30 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:33.864350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c3814d43-0f2b-4e7b-856b-8871e6b1ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:33.872904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d065df-ceac-4435-878a-b5bcf0239c71 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:33.877208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51450c-b6a9-4e65-b789-07abaaefe804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:33.877989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51450c-b6a9-4e65-b789-07abaaefe804 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:33.878326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51450c-b6a9-4e65-b789-07abaaefe804 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:33.878592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51450c-b6a9-4e65-b789-07abaaefe804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:33.880703 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4a51450c-b6a9-4e65-b789-07abaaefe804 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:33.966778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51450c-b6a9-4e65-b789-07abaaefe804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:33.968250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51450c-b6a9-4e65-b789-07abaaefe804 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:33.975480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 935/1847] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:33.976828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782ced-70eb-4d07-ac26-ed597f750e4f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:33.977141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782ced-70eb-4d07-ac26-ed597f750e4f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:33.982671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782ced-70eb-4d07-ac26-ed597f750e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:33.994973 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 913/1848] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:33 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:34.014721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51450c-b6a9-4e65-b789-07abaaefe804 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:34.016602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4a51450c-b6a9-4e65-b789-07abaaefe804 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:34.040167 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-9e782ced-70eb-4d07-ac26-ed597f750e4f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:34.045818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9e782ced-70eb-4d07-ac26-ed597f750e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:34.108634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 936/1849] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:34.124167 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f2aff-c924-4959-bd46-ab6c29354ceb None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:34.127332 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f2aff-c924-4959-bd46-ab6c29354ceb None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:34.129534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f2aff-c924-4959-bd46-ab6c29354ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:34.185014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51450c-b6a9-4e65-b789-07abaaefe804 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:34.193925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b75f2aff-c924-4959-bd46-ab6c29354ceb None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:34.198530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb179cd-315b-4623-8bbe-86931d5ce78e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:34.200369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb179cd-315b-4623-8bbe-86931d5ce78e service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:34.200737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b75f2aff-c924-4959-bd46-ab6c29354ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:34.201042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb179cd-315b-4623-8bbe-86931d5ce78e service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:34.201465 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb179cd-315b-4623-8bbe-86931d5ce78e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:34.222306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb179cd-315b-4623-8bbe-86931d5ce78e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:34.226936 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb179cd-315b-4623-8bbe-86931d5ce78e service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:34.227623 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 937/1850] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:34.229415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f2aff-c924-4959-bd46-ab6c29354ceb None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:34.251768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 914/1851] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:34.263841 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f2aff-c924-4959-bd46-ab6c29354ceb None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:34.272972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3addb-ccdd-402d-bda7-8592561c21a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:34.273831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3addb-ccdd-402d-bda7-8592561c21a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:34.274122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3addb-ccdd-402d-bda7-8592561c21a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:34.274460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3addb-ccdd-402d-bda7-8592561c21a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:34.275561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3addb-ccdd-402d-bda7-8592561c21a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:34.275728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3addb-ccdd-402d-bda7-8592561c21a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:34.279382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3addb-ccdd-402d-bda7-8592561c21a0 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:34.300207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 938/1852] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:34.304458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb179cd-315b-4623-8bbe-86931d5ce78e service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:34.321406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb179cd-315b-4623-8bbe-86931d5ce78e service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:34.338248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8dfcf-ab81-46b0-9a1c-d44fcbc22701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:34.339262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8dfcf-ab81-46b0-9a1c-d44fcbc22701 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:34.339811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8dfcf-ab81-46b0-9a1c-d44fcbc22701 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:34.341110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8dfcf-ab81-46b0-9a1c-d44fcbc22701 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:34.342989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8dfcf-ab81-46b0-9a1c-d44fcbc22701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:34.349992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8dfcf-ab81-46b0-9a1c-d44fcbc22701 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:34.390132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3addb-ccdd-402d-bda7-8592561c21a0 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:34.392960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cfc3addb-ccdd-402d-bda7-8592561c21a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:34.408371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 915/1853] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:34 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:55:34.413058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8dfcf-ab81-46b0-9a1c-d44fcbc22701 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:34.417704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3addb-ccdd-402d-bda7-8592561c21a0 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:34.555456 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99f67-0ac2-4cf5-bf92-a0a7ffe9fb3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:34.557151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99f67-0ac2-4cf5-bf92-a0a7ffe9fb3d service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:34.557452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99f67-0ac2-4cf5-bf92-a0a7ffe9fb3d service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:34.557818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d99f67-0ac2-4cf5-bf92-a0a7ffe9fb3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:34.562700 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-15d99f67-0ac2-4cf5-bf92-a0a7ffe9fb3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:34.623385 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8dfcf-ab81-46b0-9a1c-d44fcbc22701 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:34.631486 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e39320-3fab-444f-a4c5-5ebfcf243db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:34.632293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e39320-3fab-444f-a4c5-5ebfcf243db3 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:34.632699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e39320-3fab-444f-a4c5-5ebfcf243db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:34.633054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e39320-3fab-444f-a4c5-5ebfcf243db3 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:34.634763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e39320-3fab-444f-a4c5-5ebfcf243db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:34.639840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e39320-3fab-444f-a4c5-5ebfcf243db3 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:34.698934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 916/1854] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:34 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:34.702126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e39320-3fab-444f-a4c5-5ebfcf243db3 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:34.720842 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e39320-3fab-444f-a4c5-5ebfcf243db3 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:34.746975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce769a5-a3e1-412e-9b1a-efe83ce41077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:34.747946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce769a5-a3e1-412e-9b1a-efe83ce41077 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:34.748341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce769a5-a3e1-412e-9b1a-efe83ce41077 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:34.748971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce769a5-a3e1-412e-9b1a-efe83ce41077 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:34.749901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce769a5-a3e1-412e-9b1a-efe83ce41077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:34.751985 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce769a5-a3e1-412e-9b1a-efe83ce41077 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:34.759938 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d99f67-0ac2-4cf5-bf92-a0a7ffe9fb3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:34.761628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d99f67-0ac2-4cf5-bf92-a0a7ffe9fb3d service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:34.783205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 917/1855] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:55:34.784746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 939/1856] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:34.802931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce769a5-a3e1-412e-9b1a-efe83ce41077 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:34.833487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce769a5-a3e1-412e-9b1a-efe83ce41077 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:34.846663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afd05e-3809-4f55-8c08-3c950853184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:34.847708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afd05e-3809-4f55-8c08-3c950853184a admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:34.848294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afd05e-3809-4f55-8c08-3c950853184a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:34.848794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afd05e-3809-4f55-8c08-3c950853184a admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:34.850002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afd05e-3809-4f55-8c08-3c950853184a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:34.856346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afd05e-3809-4f55-8c08-3c950853184a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:34.876338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 918/1857] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:34.881006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99f67-0ac2-4cf5-bf92-a0a7ffe9fb3d service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:34.898177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d99f67-0ac2-4cf5-bf92-a0a7ffe9fb3d service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:34.912580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388a442-77fb-4a82-9c51-6fbd2e1a4e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:34.914561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388a442-77fb-4a82-9c51-6fbd2e1a4e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:34.917767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388a442-77fb-4a82-9c51-6fbd2e1a4e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:34.918722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388a442-77fb-4a82-9c51-6fbd2e1a4e06 admin admin] PATH_INFO: `/v3/projects/daff2844b0334a429d7c4ba61c492d71/users/da2a24a8b57a439fba2a6a5fe9438a27/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:34.956312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388a442-77fb-4a82-9c51-6fbd2e1a4e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daff2844b0334a429d7c4ba61c492d71, user_id=da2a24a8b57a439fba2a6a5fe9438a27, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:34.963536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388a442-77fb-4a82-9c51-6fbd2e1a4e06 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:35.006879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 940/1858] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:34 2022] PUT /identity/v3/projects/daff2844b0334a429d7c4ba61c492d71/users/da2a24a8b57a439fba2a6a5fe9438a27/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:35.019171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b437bf-21c4-47a6-b69b-e078140388b0 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:35.019659 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b437bf-21c4-47a6-b69b-e078140388b0 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:35.020134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b437bf-21c4-47a6-b69b-e078140388b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:35.111318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c6b437bf-21c4-47a6-b69b-e078140388b0 None None] MFA Rules not processed for user `da2a24a8b57a439fba2a6a5fe9438a27`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:35.115797 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c6b437bf-21c4-47a6-b69b-e078140388b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:35.224375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388a442-77fb-4a82-9c51-6fbd2e1a4e06 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:35.227234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1388a442-77fb-4a82-9c51-6fbd2e1a4e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:35.304666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 919/1859] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:35.310000 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b437bf-21c4-47a6-b69b-e078140388b0 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:35.421553 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b437bf-21c4-47a6-b69b-e078140388b0 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:35.430830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3d42-96b7-4c5a-aab0-04796695993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:35.431781 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3d42-96b7-4c5a-aab0-04796695993f admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:35.432285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3d42-96b7-4c5a-aab0-04796695993f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:35.432876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d3d42-96b7-4c5a-aab0-04796695993f admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:35.435431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d3d42-96b7-4c5a-aab0-04796695993f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:35.443688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d3d42-96b7-4c5a-aab0-04796695993f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:35.450401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388a442-77fb-4a82-9c51-6fbd2e1a4e06 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:35.505312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:35.514286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:35.517385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:35.523347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 920/1860] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:35 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:35.525774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] PATH_INFO: `/v3/projects/e42cff09eda44fc68ec1938e19a21ed6` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:35.526418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3d42-96b7-4c5a-aab0-04796695993f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:35.535836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42cff09eda44fc68ec1938e19a21ed6)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:35.549384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:35.647300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d3d42-96b7-4c5a-aab0-04796695993f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:35.663084 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdc894-21c5-4b2d-946c-3ffa62e8e62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:35.666436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc894-21c5-4b2d-946c-3ffa62e8e62d admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:35.666981 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc894-21c5-4b2d-946c-3ffa62e8e62d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:35.668657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdc894-21c5-4b2d-946c-3ffa62e8e62d admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:35.671721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdc894-21c5-4b2d-946c-3ffa62e8e62d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:35.694359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdc894-21c5-4b2d-946c-3ffa62e8e62d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:35.729249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42cff09eda44fc68ec1938e19a21ed6', 'request_id': 'req-a955d3b7-e789-46dd-8953-8594b880cf97'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:35.762232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42cff09eda44fc68ec1938e19a21ed6', 'request_id': 'req-a955d3b7-e789-46dd-8953-8594b880cf97'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:35.770187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 921/1861] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:35 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:35.779720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdc894-21c5-4b2d-946c-3ffa62e8e62d admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:35.793618 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42cff09eda44fc68ec1938e19a21ed6', 'request_id': 'req-a955d3b7-e789-46dd-8953-8594b880cf97'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:35.802923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdc894-21c5-4b2d-946c-3ffa62e8e62d admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:35.826616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] The token cache is being invalidate because project e42cff09eda44fc68ec1938e19a21ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:35.827715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:35.829442 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:35.840627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 941/1862] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:35 2022] DELETE /identity/v3/projects/e42cff09eda44fc68ec1938e19a21ed6 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:35.846754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:35.851204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:35.989616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfa6f7-ffe8-4cfd-ba83-1e54c6d47ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:35.991488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfa6f7-ffe8-4cfd-ba83-1e54c6d47ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:35.992261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfa6f7-ffe8-4cfd-ba83-1e54c6d47ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:35.992973 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfa6f7-ffe8-4cfd-ba83-1e54c6d47ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:35.994297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfa6f7-ffe8-4cfd-ba83-1e54c6d47ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:35.997168 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfa6f7-ffe8-4cfd-ba83-1e54c6d47ad3 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:36.019223 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 922/1863] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:55:36.020630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfa6f7-ffe8-4cfd-ba83-1e54c6d47ad3 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:36.022546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-41dfa6f7-ffe8-4cfd-ba83-1e54c6d47ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:36.042262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfa6f7-ffe8-4cfd-ba83-1e54c6d47ad3 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:36.049514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955d3b7-e789-46dd-8953-8594b880cf97 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:36.055562 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34474e-3bcb-4780-8c1e-d3f7c4125e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:36.057940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34474e-3bcb-4780-8c1e-d3f7c4125e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:36.058808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:36.059556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34474e-3bcb-4780-8c1e-d3f7c4125e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:36.060400 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:36.060608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34474e-3bcb-4780-8c1e-d3f7c4125e58 admin admin] PATH_INFO: `/v3/projects/f881d706be554081b7cceb3e4665dc13/users/527da4c18e74481a9a8449523e1e52a9/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:36.061448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:36.061966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] PATH_INFO: `/v3/users/55b2e627f2cc4d8ca66b4e9125090b08` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:36.064010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b2e627f2cc4d8ca66b4e9125090b08)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:36.068414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:36.092404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34474e-3bcb-4780-8c1e-d3f7c4125e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f881d706be554081b7cceb3e4665dc13, user_id=527da4c18e74481a9a8449523e1e52a9, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:36.095406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34474e-3bcb-4780-8c1e-d3f7c4125e58 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:36.120513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 923/1864] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:36 2022] PUT /identity/v3/projects/f881d706be554081b7cceb3e4665dc13/users/527da4c18e74481a9a8449523e1e52a9/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:36.123264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34474e-3bcb-4780-8c1e-d3f7c4125e58 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:36.144435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b2e627f2cc4d8ca66b4e9125090b08'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:36.145664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b2e627f2cc4d8ca66b4e9125090b08'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:36.146500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b2e627f2cc4d8ca66b4e9125090b08'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:36.174005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b2e627f2cc4d8ca66b4e9125090b08'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:36.193074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b2e627f2cc4d8ca66b4e9125090b08'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:36.219137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 942/1865] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:35 2022] DELETE /identity/v3/users/55b2e627f2cc4d8ca66b4e9125090b08 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:36.261090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34474e-3bcb-4780-8c1e-d3f7c4125e58 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:36.425814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fa03b-2560-4f7f-8380-913859739645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:36.427052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa03b-2560-4f7f-8380-913859739645 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:36.427596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa03b-2560-4f7f-8380-913859739645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:36.428133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa03b-2560-4f7f-8380-913859739645 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:36.429620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fa03b-2560-4f7f-8380-913859739645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:36.432928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fa03b-2560-4f7f-8380-913859739645 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:36.451197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 924/1866] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:55:36.457736 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:36.462888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:36.497981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc988265-a0dc-43ca-a6bc-05d267676cde admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:36.498402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fa03b-2560-4f7f-8380-913859739645 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:36.501537 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-830fa03b-2560-4f7f-8380-913859739645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:36.506170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83dfce-67c4-49f7-a28d-1a39f731b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:36.507590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83dfce-67c4-49f7-a28d-1a39f731b30a admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:36.507929 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83dfce-67c4-49f7-a28d-1a39f731b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:36.508408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83dfce-67c4-49f7-a28d-1a39f731b30a admin admin] PATH_INFO: `/v3/projects/f881d706be554081b7cceb3e4665dc13/users/527da4c18e74481a9a8449523e1e52a9/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:36.510798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83dfce-67c4-49f7-a28d-1a39f731b30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f881d706be554081b7cceb3e4665dc13, user_id=527da4c18e74481a9a8449523e1e52a9, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:36.516051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83dfce-67c4-49f7-a28d-1a39f731b30a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:36.525469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fa03b-2560-4f7f-8380-913859739645 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:36.548033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 943/1867] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:36 2022] PUT /identity/v3/projects/f881d706be554081b7cceb3e4665dc13/users/527da4c18e74481a9a8449523e1e52a9/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:55:36.555635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4fba5-bab8-4501-947b-08c7a7e1b4de None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:36.556453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4fba5-bab8-4501-947b-08c7a7e1b4de None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:36.557238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4fba5-bab8-4501-947b-08c7a7e1b4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:36.623970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-41f4fba5-bab8-4501-947b-08c7a7e1b4de None None] MFA Rules not processed for user `527da4c18e74481a9a8449523e1e52a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:36.624883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:36.625629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-41f4fba5-bab8-4501-947b-08c7a7e1b4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:36.627337 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:36.630905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:36.632979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] PATH_INFO: `/v3/users/38ae6b5070fc47c890ef8ecddf794885` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:36.637621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ae6b5070fc47c890ef8ecddf794885)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:36.643610 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:36.754589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 944/1868] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:36.774703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4fba5-bab8-4501-947b-08c7a7e1b4de None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:36.778992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-41f4fba5-bab8-4501-947b-08c7a7e1b4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:36.789830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ae6b5070fc47c890ef8ecddf794885'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:36.795161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ae6b5070fc47c890ef8ecddf794885'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:36.796349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ae6b5070fc47c890ef8ecddf794885'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:36.819596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ae6b5070fc47c890ef8ecddf794885'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:36.856276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cd58ee94-a452-4436-8506-794d15de8c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ae6b5070fc47c890ef8ecddf794885'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:36.895272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 925/1869] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:36 2022] DELETE /identity/v3/users/38ae6b5070fc47c890ef8ecddf794885 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:36.898050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54728d-4b87-46ec-ab43-e43bb82f4046 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:36.898770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54728d-4b87-46ec-ab43-e43bb82f4046 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:36.899063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54728d-4b87-46ec-ab43-e43bb82f4046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:36.951943 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3b54728d-4b87-46ec-ab43-e43bb82f4046 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:36.957652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3b54728d-4b87-46ec-ab43-e43bb82f4046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:36.998254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4fba5-bab8-4501-947b-08c7a7e1b4de None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:37.151550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a857a7-33a5-46a4-87b6-868e57a293bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:37.152829 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a857a7-33a5-46a4-87b6-868e57a293bb service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:37.153352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a857a7-33a5-46a4-87b6-868e57a293bb service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:37.153890 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a857a7-33a5-46a4-87b6-868e57a293bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:37.157814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-49a857a7-33a5-46a4-87b6-868e57a293bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:37.242533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 926/1870] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:55:37.243346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54728d-4b87-46ec-ab43-e43bb82f4046 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:37.250161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3b54728d-4b87-46ec-ab43-e43bb82f4046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:37.301653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54728d-4b87-46ec-ab43-e43bb82f4046 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:37.318431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:37.319429 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:37.319669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:37.319947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] PATH_INFO: `/v3/projects/d0b4a70d74dd48beb9be65f366b71156` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:37.321797 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0b4a70d74dd48beb9be65f366b71156)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:37.327571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:37.462930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0b4a70d74dd48beb9be65f366b71156', 'request_id': 'req-61c21e06-5cdf-4f2f-a45b-e891974a50a1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:37.473006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0b4a70d74dd48beb9be65f366b71156', 'request_id': 'req-61c21e06-5cdf-4f2f-a45b-e891974a50a1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:37.489011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0b4a70d74dd48beb9be65f366b71156', 'request_id': 'req-61c21e06-5cdf-4f2f-a45b-e891974a50a1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:37.510779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a857a7-33a5-46a4-87b6-868e57a293bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:37.525203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a857a7-33a5-46a4-87b6-868e57a293bb service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:37.536674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] The token cache is being invalidate because project d0b4a70d74dd48beb9be65f366b71156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:37.536674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:37.536674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:37.536674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 927/1871] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:37 2022] DELETE /identity/v3/projects/d0b4a70d74dd48beb9be65f366b71156 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:37.536674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:37.540098 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:37.557059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 945/1872] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:55:37.559994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0c28a-8c07-43fa-8d4c-7fda1f215fca None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:37.560472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0c28a-8c07-43fa-8d4c-7fda1f215fca None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:37.560961 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0c28a-8c07-43fa-8d4c-7fda1f215fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:37.594495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-80d0c28a-8c07-43fa-8d4c-7fda1f215fca None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:37.598940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-80d0c28a-8c07-43fa-8d4c-7fda1f215fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:37.676692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c21e06-5cdf-4f2f-a45b-e891974a50a1 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:37.686728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52430b1-0a00-41b4-a0e3-20e9791c6263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:37.688413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52430b1-0a00-41b4-a0e3-20e9791c6263 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:37.689456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52430b1-0a00-41b4-a0e3-20e9791c6263 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:37.690375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52430b1-0a00-41b4-a0e3-20e9791c6263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:37.694267 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c52430b1-0a00-41b4-a0e3-20e9791c6263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:37.714203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 946/1873] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:37.716140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0c28a-8c07-43fa-8d4c-7fda1f215fca None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:37.717712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-80d0c28a-8c07-43fa-8d4c-7fda1f215fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:37.731795 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0c28a-8c07-43fa-8d4c-7fda1f215fca None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:37.743415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:37.745398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:37.746838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:37.747555 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] PATH_INFO: `/v3/users/da2a24a8b57a439fba2a6a5fe9438a27` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:37.749874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2a24a8b57a439fba2a6a5fe9438a27)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:37.752385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:37.820746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52430b1-0a00-41b4-a0e3-20e9791c6263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:37.830051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52430b1-0a00-41b4-a0e3-20e9791c6263 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:37.844362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 928/1874] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:37.846035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9e77-931d-4f4f-995c-41aa11348622 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:37.846330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9e77-931d-4f4f-995c-41aa11348622 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:37.846641 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf9e77-931d-4f4f-995c-41aa11348622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:37.851735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2a24a8b57a439fba2a6a5fe9438a27'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:37.853808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2a24a8b57a439fba2a6a5fe9438a27'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:37.857648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2a24a8b57a439fba2a6a5fe9438a27'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:37.876349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2a24a8b57a439fba2a6a5fe9438a27'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:37.890196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-96bf9e77-931d-4f4f-995c-41aa11348622 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:37.891652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-96bf9e77-931d-4f4f-995c-41aa11348622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:37.893520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-228d5442-eb9d-428c-ab00-6179c332fe3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2a24a8b57a439fba2a6a5fe9438a27'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:37.915011 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 947/1875] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:37 2022] DELETE /identity/v3/users/da2a24a8b57a439fba2a6a5fe9438a27 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:37.921957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be26ec-93dd-4f41-928e-8762815da474 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:37.922236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 929/1876] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:37.922368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be26ec-93dd-4f41-928e-8762815da474 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:37.922821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be26ec-93dd-4f41-928e-8762815da474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:37.926879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9e77-931d-4f4f-995c-41aa11348622 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:37.945243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-61be26ec-93dd-4f41-928e-8762815da474 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:37.946571 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-61be26ec-93dd-4f41-928e-8762815da474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:37.974663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf9e77-931d-4f4f-995c-41aa11348622 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:38.034553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 948/1877] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:38.052251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be26ec-93dd-4f41-928e-8762815da474 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:38.053960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-61be26ec-93dd-4f41-928e-8762815da474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:38.108564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac304e2-6e22-4ba0-9681-22d04f262da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:38.110307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac304e2-6e22-4ba0-9681-22d04f262da3 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:38.111013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac304e2-6e22-4ba0-9681-22d04f262da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:38.111744 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac304e2-6e22-4ba0-9681-22d04f262da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:38.114228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac304e2-6e22-4ba0-9681-22d04f262da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:38.114881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac304e2-6e22-4ba0-9681-22d04f262da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:38.117547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac304e2-6e22-4ba0-9681-22d04f262da3 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:38.142571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 930/1878] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:38.142862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be26ec-93dd-4f41-928e-8762815da474 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:38.146994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb264aa-fbda-451d-adbe-f7542340c9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:38.147742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb264aa-fbda-451d-adbe-f7542340c9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:38.148224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb264aa-fbda-451d-adbe-f7542340c9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:38.148400 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb264aa-fbda-451d-adbe-f7542340c9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:38.150758 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac304e2-6e22-4ba0-9681-22d04f262da3 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:38.161630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb264aa-fbda-451d-adbe-f7542340c9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:38.163223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb264aa-fbda-451d-adbe-f7542340c9a5 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:38.176448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 949/1879] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:38.182196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac304e2-6e22-4ba0-9681-22d04f262da3 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:38.190083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a509b-e4a1-41bf-af9b-ad5b44194c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:38.191565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a509b-e4a1-41bf-af9b-ad5b44194c32 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:38.191958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a509b-e4a1-41bf-af9b-ad5b44194c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:38.192564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a509b-e4a1-41bf-af9b-ad5b44194c32 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:38.193324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a509b-e4a1-41bf-af9b-ad5b44194c32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:38.195680 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a509b-e4a1-41bf-af9b-ad5b44194c32 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:38.247974 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 931/1880] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:38 2022] POST /identity/v3/projects => generated 361 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:38.251390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb264aa-fbda-451d-adbe-f7542340c9a5 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:38.261433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb264aa-fbda-451d-adbe-f7542340c9a5 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:38.383272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc35ec4-6059-4b08-9780-7ec74ec6d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:38.383801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc35ec4-6059-4b08-9780-7ec74ec6d17b admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:38.384086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc35ec4-6059-4b08-9780-7ec74ec6d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:38.384363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc35ec4-6059-4b08-9780-7ec74ec6d17b admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:38.385725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc35ec4-6059-4b08-9780-7ec74ec6d17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:38.388166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc35ec4-6059-4b08-9780-7ec74ec6d17b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:38.422882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 950/1881] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:38 2022] POST /identity/v3/users => generated 281 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:55:38.429829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a509b-e4a1-41bf-af9b-ad5b44194c32 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:38.464340 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a509b-e4a1-41bf-af9b-ad5b44194c32 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:38.477295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc641a8-514a-4ecd-a8d1-1b04213deefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:38.481023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc641a8-514a-4ecd-a8d1-1b04213deefb admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:38.481528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc641a8-514a-4ecd-a8d1-1b04213deefb admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:38.482059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc641a8-514a-4ecd-a8d1-1b04213deefb admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:38.483434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc641a8-514a-4ecd-a8d1-1b04213deefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:38.487651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc641a8-514a-4ecd-a8d1-1b04213deefb admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:38.516184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 932/1882] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:38.522685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc35ec4-6059-4b08-9780-7ec74ec6d17b admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:38.560007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc35ec4-6059-4b08-9780-7ec74ec6d17b admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:38.569337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058138db-3b4b-4ab0-b0ea-b3f5417bc34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:38.570734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058138db-3b4b-4ab0-b0ea-b3f5417bc34b admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:38.571269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058138db-3b4b-4ab0-b0ea-b3f5417bc34b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:38.572303 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058138db-3b4b-4ab0-b0ea-b3f5417bc34b admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:38.574552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058138db-3b4b-4ab0-b0ea-b3f5417bc34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:38.577692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058138db-3b4b-4ab0-b0ea-b3f5417bc34b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:38.608909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc641a8-514a-4ecd-a8d1-1b04213deefb admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:38.611523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-dcc641a8-514a-4ecd-a8d1-1b04213deefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:38.614486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 951/1883] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:38.621919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058138db-3b4b-4ab0-b0ea-b3f5417bc34b admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:38.643383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058138db-3b4b-4ab0-b0ea-b3f5417bc34b admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:38.648862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661bc60-7400-45c3-a1c5-0f1c572c0b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:38.649913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bc60-7400-45c3-a1c5-0f1c572c0b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:38.650202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bc60-7400-45c3-a1c5-0f1c572c0b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:38.650570 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661bc60-7400-45c3-a1c5-0f1c572c0b60 admin admin] PATH_INFO: `/v3/projects/47ad3f80596c47149d94d4258a31a775/users/45e7d59f9fb6401f8a1c1c17ea5732ad/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:38.652525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc641a8-514a-4ecd-a8d1-1b04213deefb admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:38.660650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:38.662139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:38.662588 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:38.663042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] PATH_INFO: `/v3/projects/e062e6dd9d154092909c1c4784e9f71a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:38.665401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e062e6dd9d154092909c1c4784e9f71a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:38.667653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:38.670675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661bc60-7400-45c3-a1c5-0f1c572c0b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ad3f80596c47149d94d4258a31a775, user_id=45e7d59f9fb6401f8a1c1c17ea5732ad, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:38.673877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661bc60-7400-45c3-a1c5-0f1c572c0b60 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:38.701784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 952/1884] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:38 2022] PUT /identity/v3/projects/47ad3f80596c47149d94d4258a31a775/users/45e7d59f9fb6401f8a1c1c17ea5732ad/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:38.721453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1b27a-a0fe-4936-b6f0-e0a495eb4b86 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:38.721978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1b27a-a0fe-4936-b6f0-e0a495eb4b86 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:38.722363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1b27a-a0fe-4936-b6f0-e0a495eb4b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:38.732883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e062e6dd9d154092909c1c4784e9f71a', 'request_id': 'req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:38.739953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e062e6dd9d154092909c1c4784e9f71a', 'request_id': 'req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:38.750770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e062e6dd9d154092909c1c4784e9f71a', 'request_id': 'req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:38.757773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-93a1b27a-a0fe-4936-b6f0-e0a495eb4b86 None None] MFA Rules not processed for user `45e7d59f9fb6401f8a1c1c17ea5732ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:38.759398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-93a1b27a-a0fe-4936-b6f0-e0a495eb4b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:38.774273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] The token cache is being invalidate because project e062e6dd9d154092909c1c4784e9f71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:38.774785 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:38.776172 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:38.780119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 933/1885] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:38 2022] DELETE /identity/v3/projects/e062e6dd9d154092909c1c4784e9f71a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:38.786400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:38.789775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:38.906285 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 953/1886] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:38.946257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f702d49-bb2d-4bb7-b40b-1e1fc0223f0f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:38.949010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1b27a-a0fe-4936-b6f0-e0a495eb4b86 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:38.953001 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-93a1b27a-a0fe-4936-b6f0-e0a495eb4b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:38.961487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:38.962628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:38.963085 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:38.963682 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] PATH_INFO: `/v3/users/f007c4060a55467ba7be187c8d7c0229` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:38.966104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f007c4060a55467ba7be187c8d7c0229)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:38.969524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:39.091325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f007c4060a55467ba7be187c8d7c0229'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.092236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f007c4060a55467ba7be187c8d7c0229'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.093111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f007c4060a55467ba7be187c8d7c0229'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.104342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f007c4060a55467ba7be187c8d7c0229'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.133074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f007c4060a55467ba7be187c8d7c0229'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.152931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1b27a-a0fe-4936-b6f0-e0a495eb4b86 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:39.161035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159668-101c-481a-9119-2d2f03336090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:39.162113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 934/1887] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:38 2022] DELETE /identity/v3/users/f007c4060a55467ba7be187c8d7c0229 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:39.163222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:39.165144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:39.166065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159668-101c-481a-9119-2d2f03336090 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:39.170024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159668-101c-481a-9119-2d2f03336090 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:39.170306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70159668-101c-481a-9119-2d2f03336090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:39.172574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-70159668-101c-481a-9119-2d2f03336090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:39.189430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70159668-101c-481a-9119-2d2f03336090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:39.190970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70159668-101c-481a-9119-2d2f03336090 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:39.203327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 954/1888] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:55:39.218540 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159668-101c-481a-9119-2d2f03336090 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:39.220261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-70159668-101c-481a-9119-2d2f03336090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:39.238016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70159668-101c-481a-9119-2d2f03336090 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:39.283787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dd40b-c73b-4e45-a031-50ace8acfcc8 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:39.292472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:39.294056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:39.295532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:39.295846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] PATH_INFO: `/v3/projects/daff2844b0334a429d7c4ba61c492d71` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:39.297730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=daff2844b0334a429d7c4ba61c492d71)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:39.301076 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:39.320717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:39.321992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:39.322457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:39.323110 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] PATH_INFO: `/v3/users/45e7d59f9fb6401f8a1c1c17ea5732ad` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:39.326092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e7d59f9fb6401f8a1c1c17ea5732ad)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:39.329148 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:39.420379 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e7d59f9fb6401f8a1c1c17ea5732ad'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.422656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e7d59f9fb6401f8a1c1c17ea5732ad'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.428171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e7d59f9fb6401f8a1c1c17ea5732ad'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.438519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daff2844b0334a429d7c4ba61c492d71', 'request_id': 'req-ff73bed5-0d67-4d03-9df6-de3df64799fa'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.456300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daff2844b0334a429d7c4ba61c492d71', 'request_id': 'req-ff73bed5-0d67-4d03-9df6-de3df64799fa'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.479301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e7d59f9fb6401f8a1c1c17ea5732ad'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.489959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daff2844b0334a429d7c4ba61c492d71', 'request_id': 'req-ff73bed5-0d67-4d03-9df6-de3df64799fa'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.506883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] The token cache is being invalidate because project daff2844b0334a429d7c4ba61c492d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:39.507386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.508203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.510275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 935/1889] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:39 2022] DELETE /identity/v3/projects/daff2844b0334a429d7c4ba61c492d71 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:39.515419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:39.516827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:39.533448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5f7cbe90-f20b-47ea-a658-cd2057c9431c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e7d59f9fb6401f8a1c1c17ea5732ad'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.562211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 955/1890] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:39 2022] DELETE /identity/v3/users/45e7d59f9fb6401f8a1c1c17ea5732ad => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:55:39.563773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f738778-4903-46db-83a2-fefadc465ed2 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:39.564128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f738778-4903-46db-83a2-fefadc465ed2 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:39.564471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f738778-4903-46db-83a2-fefadc465ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:39.599691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-6f738778-4903-46db-83a2-fefadc465ed2 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:39.600976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6f738778-4903-46db-83a2-fefadc465ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:39.667433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73bed5-0d67-4d03-9df6-de3df64799fa admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:39.719174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 956/1891] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:39.736121 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f738778-4903-46db-83a2-fefadc465ed2 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:39.737664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6f738778-4903-46db-83a2-fefadc465ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:39.788945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:39.790573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:39.791010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:39.791465 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] PATH_INFO: `/v3/users/527da4c18e74481a9a8449523e1e52a9` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:39.794932 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=527da4c18e74481a9a8449523e1e52a9)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:39.799371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:39.819561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f738778-4903-46db-83a2-fefadc465ed2 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:39.825528 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca086a-067d-4a0b-bcf6-078e27be8cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:39.826971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca086a-067d-4a0b-bcf6-078e27be8cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:39.828199 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca086a-067d-4a0b-bcf6-078e27be8cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:39.828199 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca086a-067d-4a0b-bcf6-078e27be8cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:39.845043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca086a-067d-4a0b-bcf6-078e27be8cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:39.847730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca086a-067d-4a0b-bcf6-078e27be8cb8 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:39.863068 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 957/1892] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:55:39.885706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '527da4c18e74481a9a8449523e1e52a9'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.887129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '527da4c18e74481a9a8449523e1e52a9'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.888427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '527da4c18e74481a9a8449523e1e52a9'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.898701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '527da4c18e74481a9a8449523e1e52a9'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.924660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '527da4c18e74481a9a8449523e1e52a9'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:39.945403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 936/1893] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:39 2022] DELETE /identity/v3/users/527da4c18e74481a9a8449523e1e52a9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:40.424798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca086a-067d-4a0b-bcf6-078e27be8cb8 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:40.426631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-52ca086a-067d-4a0b-bcf6-078e27be8cb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:40.442386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca086a-067d-4a0b-bcf6-078e27be8cb8 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:40.552144 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:40.553712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:40.554231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:40.554802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] PATH_INFO: `/v3/projects/47ad3f80596c47149d94d4258a31a775` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:40.557090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ad3f80596c47149d94d4258a31a775)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:40.561867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:40.594507 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:40.598932 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:40.622634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92476976-4e7d-4b88-82c1-9ae40ad3bdf7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:40.657305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ad3f80596c47149d94d4258a31a775', 'request_id': 'req-94f90f7c-9363-4fe8-889d-bef30e8b9197'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:40.693230 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ad3f80596c47149d94d4258a31a775', 'request_id': 'req-94f90f7c-9363-4fe8-889d-bef30e8b9197'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:40.714548 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ad3f80596c47149d94d4258a31a775', 'request_id': 'req-94f90f7c-9363-4fe8-889d-bef30e8b9197'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:40.749265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] The token cache is being invalidate because project 47ad3f80596c47149d94d4258a31a775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:40.749880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:40.751253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-94f90f7c-9363-4fe8-889d-bef30e8b9197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:40.756240 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 958/1894] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:40 2022] DELETE /identity/v3/projects/47ad3f80596c47149d94d4258a31a775 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:40.765488 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af4ea-3d0e-4609-a476-2815ae47d999 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:40.766005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af4ea-3d0e-4609-a476-2815ae47d999 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:40.774051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9af4ea-3d0e-4609-a476-2815ae47d999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:40.792239 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:40.795536 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:40.796041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:40.796548 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] PATH_INFO: `/v3/projects/54489228f6b141ed8f9db812b15c01f4` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:40.799061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=54489228f6b141ed8f9db812b15c01f4)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:40.803747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:40.862035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-8b9af4ea-3d0e-4609-a476-2815ae47d999 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:40.863917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8b9af4ea-3d0e-4609-a476-2815ae47d999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:40.896783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 959/1895] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:55:40.923271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aadd0f-587e-4b6e-b68f-2f26db1c4862 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:40.923915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aadd0f-587e-4b6e-b68f-2f26db1c4862 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:40.926497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aadd0f-587e-4b6e-b68f-2f26db1c4862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:41.000280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-c2aadd0f-587e-4b6e-b68f-2f26db1c4862 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:41.010126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c2aadd0f-587e-4b6e-b68f-2f26db1c4862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:41.010904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54489228f6b141ed8f9db812b15c01f4', 'request_id': 'req-11a715a7-da23-4101-ab68-48b55a54cd2a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:41.040490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54489228f6b141ed8f9db812b15c01f4', 'request_id': 'req-11a715a7-da23-4101-ab68-48b55a54cd2a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:41.061729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54489228f6b141ed8f9db812b15c01f4', 'request_id': 'req-11a715a7-da23-4101-ab68-48b55a54cd2a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:41.087130 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] The token cache is being invalidate because project 54489228f6b141ed8f9db812b15c01f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:41.087456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:41.090270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-11a715a7-da23-4101-ab68-48b55a54cd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:41.094656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 937/1896] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:40 2022] DELETE /identity/v3/projects/54489228f6b141ed8f9db812b15c01f4 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:41.110395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33179e02-02e7-495d-875b-0ae4948b5b99 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:41.112882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33179e02-02e7-495d-875b-0ae4948b5b99 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:41.126350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33179e02-02e7-495d-875b-0ae4948b5b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:41.179777 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-33179e02-02e7-495d-875b-0ae4948b5b99 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:41.180220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 960/1897] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:55:41.181211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aadd0f-587e-4b6e-b68f-2f26db1c4862 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:41.181794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-33179e02-02e7-495d-875b-0ae4948b5b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:41.199435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 938/1898] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:41.205476 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aadd0f-587e-4b6e-b68f-2f26db1c4862 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:41.210232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc4116-2910-433d-9947-5a3df3e75efc None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:41.210857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc4116-2910-433d-9947-5a3df3e75efc None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:41.211455 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc4116-2910-433d-9947-5a3df3e75efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:41.221159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17148fb0-5040-45ba-b7d5-5424c66ce361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:41.222198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17148fb0-5040-45ba-b7d5-5424c66ce361 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:41.222494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17148fb0-5040-45ba-b7d5-5424c66ce361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:41.222773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17148fb0-5040-45ba-b7d5-5424c66ce361 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:41.223530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17148fb0-5040-45ba-b7d5-5424c66ce361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:41.223840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17148fb0-5040-45ba-b7d5-5424c66ce361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:41.231168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17148fb0-5040-45ba-b7d5-5424c66ce361 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:41.261119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 961/1899] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:41.264309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17148fb0-5040-45ba-b7d5-5424c66ce361 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:41.282786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-16fc4116-2910-433d-9947-5a3df3e75efc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:41.285028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-16fc4116-2910-433d-9947-5a3df3e75efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:41.285964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17148fb0-5040-45ba-b7d5-5424c66ce361 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:41.309752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56221bda-9377-4826-a507-d70c43f7babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:41.310917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56221bda-9377-4826-a507-d70c43f7babc admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:41.311211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56221bda-9377-4826-a507-d70c43f7babc admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:41.311476 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56221bda-9377-4826-a507-d70c43f7babc admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:41.312411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56221bda-9377-4826-a507-d70c43f7babc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:41.314507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56221bda-9377-4826-a507-d70c43f7babc admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:41.324625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 939/1900] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:41.328472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc4116-2910-433d-9947-5a3df3e75efc None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:41.388161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc4116-2910-433d-9947-5a3df3e75efc None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:41.417272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f781797-676b-403d-9ef8-6508c2eb3423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:41.422268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781797-676b-403d-9ef8-6508c2eb3423 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:41.424593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781797-676b-403d-9ef8-6508c2eb3423 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:41.425002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f781797-676b-403d-9ef8-6508c2eb3423 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:41.428040 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781797-676b-403d-9ef8-6508c2eb3423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:41.429235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781797-676b-403d-9ef8-6508c2eb3423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:41.432920 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f781797-676b-403d-9ef8-6508c2eb3423 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:41.443804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 962/1901] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:41 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:41.445392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56221bda-9377-4826-a507-d70c43f7babc admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:41.456036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 940/1902] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:41.461420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f781797-676b-403d-9ef8-6508c2eb3423 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:41.477290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f781797-676b-403d-9ef8-6508c2eb3423 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:41.581939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56221bda-9377-4826-a507-d70c43f7babc admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:41.605836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f87ad-25fa-44da-a6d8-a04b724bc19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:41.606784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f87ad-25fa-44da-a6d8-a04b724bc19f admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:41.607241 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f87ad-25fa-44da-a6d8-a04b724bc19f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:41.607674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f87ad-25fa-44da-a6d8-a04b724bc19f admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:41.608650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f87ad-25fa-44da-a6d8-a04b724bc19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:41.619115 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f87ad-25fa-44da-a6d8-a04b724bc19f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:41.695733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43d871-260e-4b11-b36b-c3dedb965c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:41.697898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43d871-260e-4b11-b36b-c3dedb965c04 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:41.698393 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43d871-260e-4b11-b36b-c3dedb965c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:41.698935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43d871-260e-4b11-b36b-c3dedb965c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:41.700388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43d871-260e-4b11-b36b-c3dedb965c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:41.710615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 963/1903] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:41 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:41.711362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43d871-260e-4b11-b36b-c3dedb965c04 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:41.711656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f87ad-25fa-44da-a6d8-a04b724bc19f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:41.742166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f53f87ad-25fa-44da-a6d8-a04b724bc19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:41.779549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 941/1904] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:41 2022] POST /identity/v3/projects => generated 399 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:55:41.780961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43d871-260e-4b11-b36b-c3dedb965c04 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:41.835066 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f87ad-25fa-44da-a6d8-a04b724bc19f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:41.872226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43d871-260e-4b11-b36b-c3dedb965c04 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:41.877286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292297e5-cd9e-4d14-b6fa-39f2e63ecd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:41.878005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292297e5-cd9e-4d14-b6fa-39f2e63ecd9b admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:41.878292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292297e5-cd9e-4d14-b6fa-39f2e63ecd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:41.878573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292297e5-cd9e-4d14-b6fa-39f2e63ecd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:41.879318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292297e5-cd9e-4d14-b6fa-39f2e63ecd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:41.880988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292297e5-cd9e-4d14-b6fa-39f2e63ecd9b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:41.912125 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 942/1905] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:41.914131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292297e5-cd9e-4d14-b6fa-39f2e63ecd9b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:41.979813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292297e5-cd9e-4d14-b6fa-39f2e63ecd9b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:41.999915 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154c1eb-bfa0-4904-b2b6-6deecd2c01b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:42.001667 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c1eb-bfa0-4904-b2b6-6deecd2c01b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.001997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c1eb-bfa0-4904-b2b6-6deecd2c01b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.002338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154c1eb-bfa0-4904-b2b6-6deecd2c01b7 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.004345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154c1eb-bfa0-4904-b2b6-6deecd2c01b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:42.007722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154c1eb-bfa0-4904-b2b6-6deecd2c01b7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:42.068139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 943/1906] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:41 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:42.069491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154c1eb-bfa0-4904-b2b6-6deecd2c01b7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:42.076029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:42.076963 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.077259 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.077530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] PATH_INFO: `/v3/projects/f881d706be554081b7cceb3e4665dc13` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.080584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f881d706be554081b7cceb3e4665dc13)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:42.087993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:42.111456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154c1eb-bfa0-4904-b2b6-6deecd2c01b7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:42.129923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe4232-70b1-45a7-94e6-f0c3e81ef169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:42.133689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe4232-70b1-45a7-94e6-f0c3e81ef169 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.134127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe4232-70b1-45a7-94e6-f0c3e81ef169 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.143237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe4232-70b1-45a7-94e6-f0c3e81ef169 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.146880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe4232-70b1-45a7-94e6-f0c3e81ef169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:42.150297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe4232-70b1-45a7-94e6-f0c3e81ef169 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:42.186542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 944/1907] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:42.187511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe4232-70b1-45a7-94e6-f0c3e81ef169 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:42.211332 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f881d706be554081b7cceb3e4665dc13', 'request_id': 'req-a037ce51-03bc-4e79-98f8-13848a55ba9c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:42.211592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe4232-70b1-45a7-94e6-f0c3e81ef169 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:42.219512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f881d706be554081b7cceb3e4665dc13', 'request_id': 'req-a037ce51-03bc-4e79-98f8-13848a55ba9c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:42.237823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f881d706be554081b7cceb3e4665dc13', 'request_id': 'req-a037ce51-03bc-4e79-98f8-13848a55ba9c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:42.255319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] The token cache is being invalidate because project f881d706be554081b7cceb3e4665dc13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:42.255685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:42.256447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:42.258937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 964/1908] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:41 2022] DELETE /identity/v3/projects/f881d706be554081b7cceb3e4665dc13 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:42.263654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:42.265713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:42.348794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037ce51-03bc-4e79-98f8-13848a55ba9c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:42.364815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806522f0-c97d-4933-af49-db38908ab108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:42.366625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806522f0-c97d-4933-af49-db38908ab108 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.367134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806522f0-c97d-4933-af49-db38908ab108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.367625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806522f0-c97d-4933-af49-db38908ab108 admin admin] PATH_INFO: `/v3/projects/4d04e3d4f47745b5bb12689bfe30aa10/users/63f5dcc30c2d40ef8c8b6b0a33aaedd5/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.405473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806522f0-c97d-4933-af49-db38908ab108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d04e3d4f47745b5bb12689bfe30aa10, user_id=63f5dcc30c2d40ef8c8b6b0a33aaedd5, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:42.410965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806522f0-c97d-4933-af49-db38908ab108 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:42.434826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1364-2097-49b8-af39-55c5105e6080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:42.435975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1364-2097-49b8-af39-55c5105e6080 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.436461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1364-2097-49b8-af39-55c5105e6080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.436960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1364-2097-49b8-af39-55c5105e6080 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.441031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1364-2097-49b8-af39-55c5105e6080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:42.447804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1364-2097-49b8-af39-55c5105e6080 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:42.452793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 965/1909] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:42 2022] PUT /identity/v3/projects/4d04e3d4f47745b5bb12689bfe30aa10/users/63f5dcc30c2d40ef8c8b6b0a33aaedd5/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:42.455328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc845-2e15-4e95-9c89-e1eb79faaca8 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.455962 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc845-2e15-4e95-9c89-e1eb79faaca8 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.456566 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ddc845-2e15-4e95-9c89-e1eb79faaca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.467897 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 945/1910] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:42.470425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1364-2097-49b8-af39-55c5105e6080 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:42.474276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1b3b1364-2097-49b8-af39-55c5105e6080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:42.487119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d1ddc845-2e15-4e95-9c89-e1eb79faaca8 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:42.489033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d1ddc845-2e15-4e95-9c89-e1eb79faaca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:42.497444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1364-2097-49b8-af39-55c5105e6080 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:42.594520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 966/1911] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:42.597216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484600e3-7603-4ce5-a83a-25b7a9ae72ee None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.597953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484600e3-7603-4ce5-a83a-25b7a9ae72ee None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.598309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484600e3-7603-4ce5-a83a-25b7a9ae72ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.625516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231505eb-e2a3-4e77-aad3-632e44049257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:42.627231 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231505eb-e2a3-4e77-aad3-632e44049257 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.628000 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231505eb-e2a3-4e77-aad3-632e44049257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.629102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231505eb-e2a3-4e77-aad3-632e44049257 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.630837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231505eb-e2a3-4e77-aad3-632e44049257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:42.634382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231505eb-e2a3-4e77-aad3-632e44049257 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:42.642128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-484600e3-7603-4ce5-a83a-25b7a9ae72ee None None] MFA Rules not processed for user `63f5dcc30c2d40ef8c8b6b0a33aaedd5`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:42.646322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-484600e3-7603-4ce5-a83a-25b7a9ae72ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:42.657736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 946/1912] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:42.661237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67badab8-0b89-4b20-9f06-6ff27faae995 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.661806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67badab8-0b89-4b20-9f06-6ff27faae995 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.662275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67badab8-0b89-4b20-9f06-6ff27faae995 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.666366 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 947/1913] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 12:55:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:55:42.669524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7bd3a-91ca-4c30-af81-4bbf883153b6 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.670092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7bd3a-91ca-4c30-af81-4bbf883153b6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.670553 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7bd3a-91ca-4c30-af81-4bbf883153b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.705745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-fcc7bd3a-91ca-4c30-af81-4bbf883153b6 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:42.707802 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-fcc7bd3a-91ca-4c30-af81-4bbf883153b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:42.747410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 948/1914] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:42.749046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7bd3a-91ca-4c30-af81-4bbf883153b6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:42.785065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7bd3a-91ca-4c30-af81-4bbf883153b6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:42.795120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 967/1915] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:42.795120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6794-4907-429d-a53d-8e435f370d6d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.795120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6794-4907-429d-a53d-8e435f370d6d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.795120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff6794-4907-429d-a53d-8e435f370d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.803534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a009c0c-510e-4846-8c74-e408e6905732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:42.805063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a009c0c-510e-4846-8c74-e408e6905732 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:42.806118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a009c0c-510e-4846-8c74-e408e6905732 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:42.811431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a009c0c-510e-4846-8c74-e408e6905732 admin admin] PATH_INFO: `/v3/projects/735b7b485fda441d822f8c3a128167fb/users/387c8823a2c545689ea51df304b92bc6/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:42.813955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-35ff6794-4907-429d-a53d-8e435f370d6d None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:42.815297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-35ff6794-4907-429d-a53d-8e435f370d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:42.862128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a009c0c-510e-4846-8c74-e408e6905732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735b7b485fda441d822f8c3a128167fb, user_id=387c8823a2c545689ea51df304b92bc6, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:42.867556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a009c0c-510e-4846-8c74-e408e6905732 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:42.911192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 968/1916] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 12:55:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:42.912514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff6794-4907-429d-a53d-8e435f370d6d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:42.918979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 949/1917] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:42 2022] PUT /identity/v3/projects/735b7b485fda441d822f8c3a128167fb/users/387c8823a2c545689ea51df304b92bc6/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:42.935098 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a009c0c-510e-4846-8c74-e408e6905732 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:42.944934 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff6794-4907-429d-a53d-8e435f370d6d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:43.092272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e95657-292f-449f-b739-69fa0630fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:43.092972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e95657-292f-449f-b739-69fa0630fd0d admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.093258 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e95657-292f-449f-b739-69fa0630fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.093538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e95657-292f-449f-b739-69fa0630fd0d admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.094396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e95657-292f-449f-b739-69fa0630fd0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:43.094914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e95657-292f-449f-b739-69fa0630fd0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:43.100486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e95657-292f-449f-b739-69fa0630fd0d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:43.142652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 969/1918] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:43.144552 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a009c0c-510e-4846-8c74-e408e6905732 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:43.144863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf30ed-9a1a-400e-92ca-bd20c12d8297 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.145328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf30ed-9a1a-400e-92ca-bd20c12d8297 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.145828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf30ed-9a1a-400e-92ca-bd20c12d8297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.172264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a5899-1afa-4008-a698-e84fb305e158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:43.175940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5899-1afa-4008-a698-e84fb305e158 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.176907 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5899-1afa-4008-a698-e84fb305e158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.178956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a5899-1afa-4008-a698-e84fb305e158 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.182708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a5899-1afa-4008-a698-e84fb305e158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:43.187437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a5899-1afa-4008-a698-e84fb305e158 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:43.224381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-bbdf30ed-9a1a-400e-92ca-bd20c12d8297 None None] MFA Rules not processed for user `387c8823a2c545689ea51df304b92bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:43.228625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bbdf30ed-9a1a-400e-92ca-bd20c12d8297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:43.273966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 950/1919] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:42 2022] POST /identity/v3/projects => generated 373 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:43.276060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a5899-1afa-4008-a698-e84fb305e158 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:43.281611 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-cd4a5899-1afa-4008-a698-e84fb305e158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:43.419350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 970/1920] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:43.420736 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf30ed-9a1a-400e-92ca-bd20c12d8297 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:43.441056 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf30ed-9a1a-400e-92ca-bd20c12d8297 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:43.533388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a5899-1afa-4008-a698-e84fb305e158 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:43.557991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609930b-fa28-4926-b65b-ca4e582cc914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:43.561161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609930b-fa28-4926-b65b-ca4e582cc914 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.562687 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609930b-fa28-4926-b65b-ca4e582cc914 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.564171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609930b-fa28-4926-b65b-ca4e582cc914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.586964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609930b-fa28-4926-b65b-ca4e582cc914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:43.592218 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609930b-fa28-4926-b65b-ca4e582cc914 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:43.608264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853bfe9-a825-4265-9459-fe234b3bf54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:43.609114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853bfe9-a825-4265-9459-fe234b3bf54c admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.609269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853bfe9-a825-4265-9459-fe234b3bf54c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.609507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853bfe9-a825-4265-9459-fe234b3bf54c admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.610269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853bfe9-a825-4265-9459-fe234b3bf54c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:43.619254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853bfe9-a825-4265-9459-fe234b3bf54c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:43.635719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 951/1921] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:43.638244 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609930b-fa28-4926-b65b-ca4e582cc914 service nova] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:43.678910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609930b-fa28-4926-b65b-ca4e582cc914 service nova] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:43.680167 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 971/1922] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:43 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:43.682300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853bfe9-a825-4265-9459-fe234b3bf54c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:43.789109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904c2bc-8a47-405f-b6a7-6091f7189079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:43.789927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904c2bc-8a47-405f-b6a7-6091f7189079 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.790258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904c2bc-8a47-405f-b6a7-6091f7189079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.790538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904c2bc-8a47-405f-b6a7-6091f7189079 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.791258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904c2bc-8a47-405f-b6a7-6091f7189079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:43.793331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853bfe9-a825-4265-9459-fe234b3bf54c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:43.794388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904c2bc-8a47-405f-b6a7-6091f7189079 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:43.799455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037c2fb-754d-4de9-8730-a873a651ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:43.800355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037c2fb-754d-4de9-8730-a873a651ccac admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.800789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037c2fb-754d-4de9-8730-a873a651ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.801353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037c2fb-754d-4de9-8730-a873a651ccac admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.802276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037c2fb-754d-4de9-8730-a873a651ccac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:43.804628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037c2fb-754d-4de9-8730-a873a651ccac admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:43.819216 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 952/1923] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:43 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:43.820242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904c2bc-8a47-405f-b6a7-6091f7189079 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:43.835981 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904c2bc-8a47-405f-b6a7-6091f7189079 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:43.841936 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296cd6b-17dd-48ae-8db6-f26996d9ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:43.842626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296cd6b-17dd-48ae-8db6-f26996d9ff01 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.842913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296cd6b-17dd-48ae-8db6-f26996d9ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.843193 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296cd6b-17dd-48ae-8db6-f26996d9ff01 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.843895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296cd6b-17dd-48ae-8db6-f26996d9ff01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:43.845900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296cd6b-17dd-48ae-8db6-f26996d9ff01 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:43.847080 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 972/1924] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:43 2022] POST /identity/v3/projects => generated 399 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:43.848560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037c2fb-754d-4de9-8730-a873a651ccac admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:43.866498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 953/1925] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:43 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:43.867325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296cd6b-17dd-48ae-8db6-f26996d9ff01 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:43.877250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296cd6b-17dd-48ae-8db6-f26996d9ff01 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:43.935752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037c2fb-754d-4de9-8730-a873a651ccac admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:43.941899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104011bf-929f-4fa1-b98d-2e217468e510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:43.943102 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104011bf-929f-4fa1-b98d-2e217468e510 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.943480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104011bf-929f-4fa1-b98d-2e217468e510 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.943925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104011bf-929f-4fa1-b98d-2e217468e510 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.944763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104011bf-929f-4fa1-b98d-2e217468e510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:43.946675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104011bf-929f-4fa1-b98d-2e217468e510 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:43.948681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aee8f5-f85e-4ea3-9eda-820c13fb99f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:43.950575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aee8f5-f85e-4ea3-9eda-820c13fb99f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.950845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aee8f5-f85e-4ea3-9eda-820c13fb99f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.951227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aee8f5-f85e-4ea3-9eda-820c13fb99f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.952783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aee8f5-f85e-4ea3-9eda-820c13fb99f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:43.956843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aee8f5-f85e-4ea3-9eda-820c13fb99f6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:43.962479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 973/1926] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:43.963855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104011bf-929f-4fa1-b98d-2e217468e510 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:43.980565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104011bf-929f-4fa1-b98d-2e217468e510 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:43.987502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 954/1927] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:43 2022] POST /identity/v3/users => generated 306 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:43.988301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aee8f5-f85e-4ea3-9eda-820c13fb99f6 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:43.992203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bad76-a55d-4cc9-b782-205c9a09e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:43.992814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bad76-a55d-4cc9-b782-205c9a09e52f admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:43.993181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bad76-a55d-4cc9-b782-205c9a09e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:43.993401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bad76-a55d-4cc9-b782-205c9a09e52f admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:43.994170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bad76-a55d-4cc9-b782-205c9a09e52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:43.997027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bad76-a55d-4cc9-b782-205c9a09e52f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.001347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aee8f5-f85e-4ea3-9eda-820c13fb99f6 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.008975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f187af-d390-4a52-aa88-b981f120b102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.010858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f187af-d390-4a52-aa88-b981f120b102 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.011232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f187af-d390-4a52-aa88-b981f120b102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.012263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f187af-d390-4a52-aa88-b981f120b102 admin admin] PATH_INFO: `/v3/projects/664d7ea3954c47c0a02def366529823f/users/94dd09861da3453088fa3caed87ae582/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.014430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 974/1928] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:44.016423 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bad76-a55d-4cc9-b782-205c9a09e52f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.036492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bad76-a55d-4cc9-b782-205c9a09e52f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.043576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f187af-d390-4a52-aa88-b981f120b102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664d7ea3954c47c0a02def366529823f, user_id=94dd09861da3453088fa3caed87ae582, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.045705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14f5d5-bb24-4f96-96d8-e208564e4f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.047051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f5d5-bb24-4f96-96d8-e208564e4f1f admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.047520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f5d5-bb24-4f96-96d8-e208564e4f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.049034 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f187af-d390-4a52-aa88-b981f120b102 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.049378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14f5d5-bb24-4f96-96d8-e208564e4f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.051188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14f5d5-bb24-4f96-96d8-e208564e4f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.055276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14f5d5-bb24-4f96-96d8-e208564e4f1f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.075500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 955/1929] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:43 2022] PUT /identity/v3/projects/664d7ea3954c47c0a02def366529823f/users/94dd09861da3453088fa3caed87ae582/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:44.075500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f187af-d390-4a52-aa88-b981f120b102 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.078010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 975/1930] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:44.079604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14f5d5-bb24-4f96-96d8-e208564e4f1f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.095542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14f5d5-bb24-4f96-96d8-e208564e4f1f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.174214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f187af-d390-4a52-aa88-b981f120b102 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.175650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463e49b-8cba-4fb9-afdc-46194f166cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.176345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463e49b-8cba-4fb9-afdc-46194f166cba admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.176633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463e49b-8cba-4fb9-afdc-46194f166cba admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.176913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463e49b-8cba-4fb9-afdc-46194f166cba admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.177708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463e49b-8cba-4fb9-afdc-46194f166cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.179331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463e49b-8cba-4fb9-afdc-46194f166cba admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.180289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6211ba9-84d9-43bb-8878-dc20b594a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.181157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211ba9-84d9-43bb-8878-dc20b594a9ed admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.181510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211ba9-84d9-43bb-8878-dc20b594a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.181983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6211ba9-84d9-43bb-8878-dc20b594a9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.182846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6211ba9-84d9-43bb-8878-dc20b594a9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.185238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6211ba9-84d9-43bb-8878-dc20b594a9ed admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.191664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 976/1931] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:44.192342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463e49b-8cba-4fb9-afdc-46194f166cba admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.197683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 956/1932] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:44.198523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6211ba9-84d9-43bb-8878-dc20b594a9ed admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.206022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463e49b-8cba-4fb9-afdc-46194f166cba admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.211104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a7924-380b-4bcb-8023-be1bcb77dce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.212009 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7924-380b-4bcb-8023-be1bcb77dce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.212294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7924-380b-4bcb-8023-be1bcb77dce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.212592 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a7924-380b-4bcb-8023-be1bcb77dce7 admin admin] PATH_INFO: `/v3/projects/cb421773d1334c2e978f8c29e033afe8/users/79ad98d41a794906bd4281260915b898/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.212769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6211ba9-84d9-43bb-8878-dc20b594a9ed admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.218568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b354e-349b-47a3-a628-b40cbbe109f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.219476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b354e-349b-47a3-a628-b40cbbe109f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.219758 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b354e-349b-47a3-a628-b40cbbe109f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.220056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b354e-349b-47a3-a628-b40cbbe109f1 admin admin] PATH_INFO: `/v3/projects/664d7ea3954c47c0a02def366529823f/users/94dd09861da3453088fa3caed87ae582/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.222220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b354e-349b-47a3-a628-b40cbbe109f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664d7ea3954c47c0a02def366529823f, user_id=94dd09861da3453088fa3caed87ae582, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.225086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b354e-349b-47a3-a628-b40cbbe109f1 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.235003 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7924-380b-4bcb-8023-be1bcb77dce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb421773d1334c2e978f8c29e033afe8, user_id=79ad98d41a794906bd4281260915b898, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.239907 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 957/1933] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:44 2022] PUT /identity/v3/projects/664d7ea3954c47c0a02def366529823f/users/94dd09861da3453088fa3caed87ae582/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:44.240150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a7924-380b-4bcb-8023-be1bcb77dce7 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.240466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b354e-349b-47a3-a628-b40cbbe109f1 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.266990 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 977/1934] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:44 2022] PUT /identity/v3/projects/cb421773d1334c2e978f8c29e033afe8/users/79ad98d41a794906bd4281260915b898/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:44.269059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f536a-a580-4cf6-90c7-4779ac0f065a None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.269648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f536a-a580-4cf6-90c7-4779ac0f065a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.270187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f536a-a580-4cf6-90c7-4779ac0f065a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.313323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-eb1f536a-a580-4cf6-90c7-4779ac0f065a None None] MFA Rules not processed for user `94dd09861da3453088fa3caed87ae582`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:44.314573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-eb1f536a-a580-4cf6-90c7-4779ac0f065a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:44.330568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b354e-349b-47a3-a628-b40cbbe109f1 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.395729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcbd7f-ba76-4821-9ba8-25f2e4de61f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.396674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcbd7f-ba76-4821-9ba8-25f2e4de61f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.396956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcbd7f-ba76-4821-9ba8-25f2e4de61f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.397235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcbd7f-ba76-4821-9ba8-25f2e4de61f2 admin admin] PATH_INFO: `/v3/projects/7390875b2b0d455bbc4b8e3b0ce20912/users/f1e7e3d2858140888e9fcd33a4c234de/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.401133 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 978/1935] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:44.402194 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f536a-a580-4cf6-90c7-4779ac0f065a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.413165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcbd7f-ba76-4821-9ba8-25f2e4de61f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7390875b2b0d455bbc4b8e3b0ce20912, user_id=f1e7e3d2858140888e9fcd33a4c234de, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.414670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f536a-a580-4cf6-90c7-4779ac0f065a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.415895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcbd7f-ba76-4821-9ba8-25f2e4de61f2 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.420525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4483b-003a-4900-aae4-997527f40611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.421205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4483b-003a-4900-aae4-997527f40611 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.421491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4483b-003a-4900-aae4-997527f40611 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.422023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4483b-003a-4900-aae4-997527f40611 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.422861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4483b-003a-4900-aae4-997527f40611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.424690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4483b-003a-4900-aae4-997527f40611 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.431471 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 958/1936] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:44 2022] PUT /identity/v3/projects/7390875b2b0d455bbc4b8e3b0ce20912/users/f1e7e3d2858140888e9fcd33a4c234de/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:44.432875 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcbd7f-ba76-4821-9ba8-25f2e4de61f2 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.434845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e8dcbd7f-ba76-4821-9ba8-25f2e4de61f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:44.446076 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 979/1937] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:44.447933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0bc6-ec7e-4aab-ad22-ec7a818c2189 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.448316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0bc6-ec7e-4aab-ad22-ec7a818c2189 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.449316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0bc6-ec7e-4aab-ad22-ec7a818c2189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.478785 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b9de0bc6-ec7e-4aab-ad22-ec7a818c2189 None None] MFA Rules not processed for user `f1e7e3d2858140888e9fcd33a4c234de`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:44.480782 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b9de0bc6-ec7e-4aab-ad22-ec7a818c2189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:44.513816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcbd7f-ba76-4821-9ba8-25f2e4de61f2 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.517748 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e71fe-66e5-4799-b8e6-e75f515d4b4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.518423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e71fe-66e5-4799-b8e6-e75f515d4b4c service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.518837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e71fe-66e5-4799-b8e6-e75f515d4b4c service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.518967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e71fe-66e5-4799-b8e6-e75f515d4b4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.559115 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 980/1938] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:44.560197 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0bc6-ec7e-4aab-ad22-ec7a818c2189 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.587950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e71fe-66e5-4799-b8e6-e75f515d4b4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.589610 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e71fe-66e5-4799-b8e6-e75f515d4b4c service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.599837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 959/1939] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:44.600683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e71fe-66e5-4799-b8e6-e75f515d4b4c service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.658363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0bc6-ec7e-4aab-ad22-ec7a818c2189 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.666116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e9211-36a7-45f4-b2b4-3510ebda2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.667113 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e9211-36a7-45f4-b2b4-3510ebda2b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.667399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e9211-36a7-45f4-b2b4-3510ebda2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.668700 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e9211-36a7-45f4-b2b4-3510ebda2b08 admin admin] PATH_INFO: `/v3/projects/cb421773d1334c2e978f8c29e033afe8/users/79ad98d41a794906bd4281260915b898/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.669614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e71fe-66e5-4799-b8e6-e75f515d4b4c service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.671497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e9211-36a7-45f4-b2b4-3510ebda2b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb421773d1334c2e978f8c29e033afe8, user_id=79ad98d41a794906bd4281260915b898, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.674796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e9211-36a7-45f4-b2b4-3510ebda2b08 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.676046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542bca0-d307-4817-becb-1b29a494e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.676882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542bca0-d307-4817-becb-1b29a494e8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.677315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542bca0-d307-4817-becb-1b29a494e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.677787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542bca0-d307-4817-becb-1b29a494e8b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.678747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542bca0-d307-4817-becb-1b29a494e8b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.681030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542bca0-d307-4817-becb-1b29a494e8b9 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.698643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 981/1940] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:44 2022] PUT /identity/v3/projects/cb421773d1334c2e978f8c29e033afe8/users/79ad98d41a794906bd4281260915b898/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:44.700854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc6bd-cbfe-4c06-8a76-1211e9eecd8e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.702386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc6bd-cbfe-4c06-8a76-1211e9eecd8e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.702510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffc6bd-cbfe-4c06-8a76-1211e9eecd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.729288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 960/1941] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:44 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:44.734745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542bca0-d307-4817-becb-1b29a494e8b9 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.768481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-96ffc6bd-cbfe-4c06-8a76-1211e9eecd8e None None] MFA Rules not processed for user `79ad98d41a794906bd4281260915b898`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:44.771652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-96ffc6bd-cbfe-4c06-8a76-1211e9eecd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:44.807541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542bca0-d307-4817-becb-1b29a494e8b9 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.815634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0001-a6d8-49f3-a747-17c723f408e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.816697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0001-a6d8-49f3-a747-17c723f408e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.817222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0001-a6d8-49f3-a747-17c723f408e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.817710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0001-a6d8-49f3-a747-17c723f408e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.818739 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f0001-a6d8-49f3-a747-17c723f408e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.821000 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f0001-a6d8-49f3-a747-17c723f408e2 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.850291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 961/1942] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:44 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:44.854800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0001-a6d8-49f3-a747-17c723f408e2 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.877659 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0001-a6d8-49f3-a747-17c723f408e2 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.885422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900210e0-6777-4161-b25e-7de7c1837772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.886305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900210e0-6777-4161-b25e-7de7c1837772 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.886895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900210e0-6777-4161-b25e-7de7c1837772 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.887367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900210e0-6777-4161-b25e-7de7c1837772 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.888164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900210e0-6777-4161-b25e-7de7c1837772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.889962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900210e0-6777-4161-b25e-7de7c1837772 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.902723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 962/1943] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:44.906841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900210e0-6777-4161-b25e-7de7c1837772 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.921255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 982/1944] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:44 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:44.922629 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900210e0-6777-4161-b25e-7de7c1837772 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.933002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb846-3318-44f8-b678-30770077b881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:44.934565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb846-3318-44f8-b678-30770077b881 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:44.935059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb846-3318-44f8-b678-30770077b881 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:44.935654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbb846-3318-44f8-b678-30770077b881 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:44.937058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbb846-3318-44f8-b678-30770077b881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:44.940932 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbb846-3318-44f8-b678-30770077b881 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:44.947281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc6bd-cbfe-4c06-8a76-1211e9eecd8e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.949980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-96ffc6bd-cbfe-4c06-8a76-1211e9eecd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:44.968155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 963/1945] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:55:44.982647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb846-3318-44f8-b678-30770077b881 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:44.993400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbb846-3318-44f8-b678-30770077b881 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:44.999202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d1be4-92b9-4057-8c30-738e07a25fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:45.000553 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1be4-92b9-4057-8c30-738e07a25fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.000837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1be4-92b9-4057-8c30-738e07a25fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.001119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1be4-92b9-4057-8c30-738e07a25fe7 admin admin] PATH_INFO: `/v3/projects/2900e624367443a28281ca40a75490f0/users/db761e870e1543dea9c766ee198b17d7/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.042106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d1be4-92b9-4057-8c30-738e07a25fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2900e624367443a28281ca40a75490f0, user_id=db761e870e1543dea9c766ee198b17d7, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:45.045741 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d1be4-92b9-4057-8c30-738e07a25fe7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:45.069852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 964/1946] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:44 2022] PUT /identity/v3/projects/2900e624367443a28281ca40a75490f0/users/db761e870e1543dea9c766ee198b17d7/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:45.080703 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e35fc-bcee-445a-b87b-2cd7bef106a3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.081116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e35fc-bcee-445a-b87b-2cd7bef106a3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.081533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e35fc-bcee-445a-b87b-2cd7bef106a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.087532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffc6bd-cbfe-4c06-8a76-1211e9eecd8e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:45.122071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-460e35fc-bcee-445a-b87b-2cd7bef106a3 None None] MFA Rules not processed for user `db761e870e1543dea9c766ee198b17d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:45.124351 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-460e35fc-bcee-445a-b87b-2cd7bef106a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:45.166862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc6d4-6bdb-48be-af8c-8ed559209f46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:45.168735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc6d4-6bdb-48be-af8c-8ed559209f46 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.169626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc6d4-6bdb-48be-af8c-8ed559209f46 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.169945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc6d4-6bdb-48be-af8c-8ed559209f46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.228443 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 965/1947] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:55:45.230528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e35fc-bcee-445a-b87b-2cd7bef106a3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:45.257600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfc6d4-6bdb-48be-af8c-8ed559209f46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:45.259648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfc6d4-6bdb-48be-af8c-8ed559209f46 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:45.277871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 983/1948] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:44 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:55:45.348822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e35fc-bcee-445a-b87b-2cd7bef106a3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:45.355120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668c9fe-74f3-4286-bff0-f8b4f906bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:45.355589 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668c9fe-74f3-4286-bff0-f8b4f906bc83 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.355871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668c9fe-74f3-4286-bff0-f8b4f906bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.356143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668c9fe-74f3-4286-bff0-f8b4f906bc83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.356844 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668c9fe-74f3-4286-bff0-f8b4f906bc83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:45.358817 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668c9fe-74f3-4286-bff0-f8b4f906bc83 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:45.387040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc6d4-6bdb-48be-af8c-8ed559209f46 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:45.393292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 966/1949] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:45 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:55:45.397493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668c9fe-74f3-4286-bff0-f8b4f906bc83 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:45.402055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc6d4-6bdb-48be-af8c-8ed559209f46 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:45.458415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ef0ae-5355-46b2-9ff7-effcd59fa281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:45.459085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ef0ae-5355-46b2-9ff7-effcd59fa281 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.459368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ef0ae-5355-46b2-9ff7-effcd59fa281 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.459642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ef0ae-5355-46b2-9ff7-effcd59fa281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.466356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668c9fe-74f3-4286-bff0-f8b4f906bc83 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:45.471297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577a01e-a720-4cad-8e8c-073ac3287bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:45.471978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577a01e-a720-4cad-8e8c-073ac3287bbe admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.472263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577a01e-a720-4cad-8e8c-073ac3287bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.472544 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577a01e-a720-4cad-8e8c-073ac3287bbe admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.473255 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577a01e-a720-4cad-8e8c-073ac3287bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:45.475261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577a01e-a720-4cad-8e8c-073ac3287bbe admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:45.500081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 967/1950] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:45 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:55:45.504245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577a01e-a720-4cad-8e8c-073ac3287bbe admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:45.515155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577a01e-a720-4cad-8e8c-073ac3287bbe admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:45.519899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fec0a0-7369-46d1-bc67-53eb2cd32607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:45.520635 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fec0a0-7369-46d1-bc67-53eb2cd32607 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.520862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fec0a0-7369-46d1-bc67-53eb2cd32607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.521140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fec0a0-7369-46d1-bc67-53eb2cd32607 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.521908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fec0a0-7369-46d1-bc67-53eb2cd32607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:45.523557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fec0a0-7369-46d1-bc67-53eb2cd32607 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:45.534571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 968/1951] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:55:45.540152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ef0ae-5355-46b2-9ff7-effcd59fa281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:45.543918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ef0ae-5355-46b2-9ff7-effcd59fa281 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:45.545589 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fec0a0-7369-46d1-bc67-53eb2cd32607 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:45.555223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 984/1952] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:55:45.560406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fec0a0-7369-46d1-bc67-53eb2cd32607 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:45.567430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447255b6-aec7-4208-8a04-421d57ff25cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:45.568962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447255b6-aec7-4208-8a04-421d57ff25cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.569459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447255b6-aec7-4208-8a04-421d57ff25cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.569925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447255b6-aec7-4208-8a04-421d57ff25cb admin admin] PATH_INFO: `/v3/projects/f248b6ef49a54eb7bcceb0e200764722/users/26e6dc69c4fb4ddaaf29c71b3d3a76df/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.595720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447255b6-aec7-4208-8a04-421d57ff25cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f248b6ef49a54eb7bcceb0e200764722, user_id=26e6dc69c4fb4ddaaf29c71b3d3a76df, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:45.601424 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447255b6-aec7-4208-8a04-421d57ff25cb admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:45.623181 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 969/1953] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:45 2022] PUT /identity/v3/projects/f248b6ef49a54eb7bcceb0e200764722/users/26e6dc69c4fb4ddaaf29c71b3d3a76df/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:45.629618 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ef0ae-5355-46b2-9ff7-effcd59fa281 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:45.649363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ef0ae-5355-46b2-9ff7-effcd59fa281 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:45.725185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eda734-7041-4ca3-8ab7-ab0c7b22af2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:45.725997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eda734-7041-4ca3-8ab7-ab0c7b22af2a admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.726176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eda734-7041-4ca3-8ab7-ab0c7b22af2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.726491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eda734-7041-4ca3-8ab7-ab0c7b22af2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.727157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eda734-7041-4ca3-8ab7-ab0c7b22af2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:45.729036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eda734-7041-4ca3-8ab7-ab0c7b22af2a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:45.741704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 985/1954] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:45.746486 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447255b6-aec7-4208-8a04-421d57ff25cb admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:45.759606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447255b6-aec7-4208-8a04-421d57ff25cb admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:45.765155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5113ff-524d-48f2-8a09-b6bc9f6a5a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:45.766116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5113ff-524d-48f2-8a09-b6bc9f6a5a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.766398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5113ff-524d-48f2-8a09-b6bc9f6a5a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.766677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5113ff-524d-48f2-8a09-b6bc9f6a5a53 admin admin] PATH_INFO: `/v3/projects/f248b6ef49a54eb7bcceb0e200764722/users/26e6dc69c4fb4ddaaf29c71b3d3a76df/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.768768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5113ff-524d-48f2-8a09-b6bc9f6a5a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f248b6ef49a54eb7bcceb0e200764722, user_id=26e6dc69c4fb4ddaaf29c71b3d3a76df, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:45.771728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5113ff-524d-48f2-8a09-b6bc9f6a5a53 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:45.783061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 970/1955] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:45 2022] PUT /identity/v3/projects/f248b6ef49a54eb7bcceb0e200764722/users/26e6dc69c4fb4ddaaf29c71b3d3a76df/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:45.795337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd763-0bdd-43a1-ae5f-80dbace99825 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:45.795614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd763-0bdd-43a1-ae5f-80dbace99825 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:45.795890 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bd763-0bdd-43a1-ae5f-80dbace99825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:45.825502 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-fa7bd763-0bdd-43a1-ae5f-80dbace99825 None None] MFA Rules not processed for user `26e6dc69c4fb4ddaaf29c71b3d3a76df`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:45.826079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-fa7bd763-0bdd-43a1-ae5f-80dbace99825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:45.922268 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 986/1956] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:45.934128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5113ff-524d-48f2-8a09-b6bc9f6a5a53 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:46.001984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5113ff-524d-48f2-8a09-b6bc9f6a5a53 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:46.005813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55f831-53e0-4e49-9033-f0f1541976be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:46.006468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55f831-53e0-4e49-9033-f0f1541976be service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:46.006749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55f831-53e0-4e49-9033-f0f1541976be service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:46.007026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55f831-53e0-4e49-9033-f0f1541976be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:46.017703 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55f831-53e0-4e49-9033-f0f1541976be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:46.019270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55f831-53e0-4e49-9033-f0f1541976be service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:46.029624 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 971/1957] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:55:46.751613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bd763-0bdd-43a1-ae5f-80dbace99825 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:46.761766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bd763-0bdd-43a1-ae5f-80dbace99825 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:46.765524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ee18-99c3-4890-8c03-29a8c5abe115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:46.766215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ee18-99c3-4890-8c03-29a8c5abe115 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:46.766493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ee18-99c3-4890-8c03-29a8c5abe115 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:46.766761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ee18-99c3-4890-8c03-29a8c5abe115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:46.831158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ee18-99c3-4890-8c03-29a8c5abe115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:46.832649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ee18-99c3-4890-8c03-29a8c5abe115 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:46.843305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 987/1958] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:48.157445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55f831-53e0-4e49-9033-f0f1541976be service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:48.158934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3f55f831-53e0-4e49-9033-f0f1541976be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:48.236005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55f831-53e0-4e49-9033-f0f1541976be service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:48.243614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:48.244518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:48.244805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:48.245191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] PATH_INFO: `/v3/users/96eb2c2cbe4d4af89b6d54b07d3e09d3` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:48.247268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96eb2c2cbe4d4af89b6d54b07d3e09d3)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:48.249254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:48.306948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96eb2c2cbe4d4af89b6d54b07d3e09d3'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:48.307384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96eb2c2cbe4d4af89b6d54b07d3e09d3'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:48.309468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96eb2c2cbe4d4af89b6d54b07d3e09d3'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:48.318049 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96eb2c2cbe4d4af89b6d54b07d3e09d3'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:48.334148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96eb2c2cbe4d4af89b6d54b07d3e09d3'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:48.354386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 972/1959] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:48 2022] DELETE /identity/v3/users/96eb2c2cbe4d4af89b6d54b07d3e09d3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:48.361273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85df0f-85ea-41a4-927f-6a6268f5ae75 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:48.362055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85df0f-85ea-41a4-927f-6a6268f5ae75 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:48.362055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85df0f-85ea-41a4-927f-6a6268f5ae75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:48.383564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-4d85df0f-85ea-41a4-927f-6a6268f5ae75 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:48.385101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4d85df0f-85ea-41a4-927f-6a6268f5ae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:48.462679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 988/1960] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:55:48.477019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:48.478552 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:48.499867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85df0f-85ea-41a4-927f-6a6268f5ae75 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:48.502035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4d85df0f-85ea-41a4-927f-6a6268f5ae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:48.520958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85df0f-85ea-41a4-927f-6a6268f5ae75 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:48.536295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:48.537354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:48.538679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:48.539121 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] PATH_INFO: `/v3/users/63f5dcc30c2d40ef8c8b6b0a33aaedd5` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:48.544643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f5dcc30c2d40ef8c8b6b0a33aaedd5)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:48.549723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:48.578258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476e198-44e3-4410-9c03-532fa69f6974 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:48.584031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e877fb-a1d8-422a-9466-6eb6ab2cfd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:48.585322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e877fb-a1d8-422a-9466-6eb6ab2cfd01 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:48.586622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e877fb-a1d8-422a-9466-6eb6ab2cfd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:48.587118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e877fb-a1d8-422a-9466-6eb6ab2cfd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:48.625925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e877fb-a1d8-422a-9466-6eb6ab2cfd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:48.629176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e877fb-a1d8-422a-9466-6eb6ab2cfd01 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:48.640098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f5dcc30c2d40ef8c8b6b0a33aaedd5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:48.640786 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f5dcc30c2d40ef8c8b6b0a33aaedd5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:48.641769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f5dcc30c2d40ef8c8b6b0a33aaedd5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:48.649952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 973/1961] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:48.655978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f5dcc30c2d40ef8c8b6b0a33aaedd5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:48.667249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f5dcc30c2d40ef8c8b6b0a33aaedd5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:48.683589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 989/1962] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:48 2022] DELETE /identity/v3/users/63f5dcc30c2d40ef8c8b6b0a33aaedd5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:48.695316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ce770-4dd3-4c06-b9cf-f59a010740d0 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:48.695316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ce770-4dd3-4c06-b9cf-f59a010740d0 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:48.695316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ce770-4dd3-4c06-b9cf-f59a010740d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:48.740804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-742ce770-4dd3-4c06-b9cf-f59a010740d0 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:48.742955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-742ce770-4dd3-4c06-b9cf-f59a010740d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:48.834192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 974/1963] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:48.901546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:48.903921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:49.000358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5390c8-859d-4373-8f78-15d074ba2d7d admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:49.008816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd00ab3-4c77-46fa-aa0c-81bd4619f08e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:49.010027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd00ab3-4c77-46fa-aa0c-81bd4619f08e service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:49.010683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd00ab3-4c77-46fa-aa0c-81bd4619f08e service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:49.011295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd00ab3-4c77-46fa-aa0c-81bd4619f08e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:49.030435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd00ab3-4c77-46fa-aa0c-81bd4619f08e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:49.034594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd00ab3-4c77-46fa-aa0c-81bd4619f08e service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:49.056957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 990/1964] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:49.788342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ce770-4dd3-4c06-b9cf-f59a010740d0 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:49.789912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-742ce770-4dd3-4c06-b9cf-f59a010740d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:49.810284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ce770-4dd3-4c06-b9cf-f59a010740d0 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:49.827106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:49.830230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:49.831721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:49.833011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] PATH_INFO: `/v3/projects/180ef56eaf7949388e8f1f9077ec6842` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:49.837664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=180ef56eaf7949388e8f1f9077ec6842)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:49.842852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:49.979359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180ef56eaf7949388e8f1f9077ec6842', 'request_id': 'req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.013251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd00ab3-4c77-46fa-aa0c-81bd4619f08e service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:50.015383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9dd00ab3-4c77-46fa-aa0c-81bd4619f08e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:50.020120 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180ef56eaf7949388e8f1f9077ec6842', 'request_id': 'req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.048488 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd00ab3-4c77-46fa-aa0c-81bd4619f08e service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:50.051108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180ef56eaf7949388e8f1f9077ec6842', 'request_id': 'req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.085661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] The token cache is being invalidate because project 180ef56eaf7949388e8f1f9077ec6842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:50.101044 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.103459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.113261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 975/1965] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:49 2022] DELETE /identity/v3/projects/180ef56eaf7949388e8f1f9077ec6842 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:55:50.120322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:50.130921 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:50.272324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:50.273486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:50.276497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:50.277502 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] PATH_INFO: `/v3/projects/4d04e3d4f47745b5bb12689bfe30aa10` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:50.281765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d04e3d4f47745b5bb12689bfe30aa10)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:50.286155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:50.356841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f45dcc-d1c5-4f5a-b6e3-94c709e51af7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:50.373737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:50.376663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:50.381247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:50.382327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] PATH_INFO: `/v3/users/4a0b2f2c22ad413a995476d130ebd7f4` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:50.385391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a0b2f2c22ad413a995476d130ebd7f4)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:50.391618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:50.437507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d04e3d4f47745b5bb12689bfe30aa10', 'request_id': 'req-3f1a74c2-5019-471c-9fc8-abadbb54b924'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.455277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d04e3d4f47745b5bb12689bfe30aa10', 'request_id': 'req-3f1a74c2-5019-471c-9fc8-abadbb54b924'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.468801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d04e3d4f47745b5bb12689bfe30aa10', 'request_id': 'req-3f1a74c2-5019-471c-9fc8-abadbb54b924'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.482593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] The token cache is being invalidate because project 4d04e3d4f47745b5bb12689bfe30aa10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:50.482969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.485701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.490256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 991/1966] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:50 2022] DELETE /identity/v3/projects/4d04e3d4f47745b5bb12689bfe30aa10 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:50.492316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:50.495089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:50.499642 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a0b2f2c22ad413a995476d130ebd7f4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.500391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a0b2f2c22ad413a995476d130ebd7f4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.501009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a0b2f2c22ad413a995476d130ebd7f4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.517009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a0b2f2c22ad413a995476d130ebd7f4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.543687 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a0b2f2c22ad413a995476d130ebd7f4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.587652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 976/1967] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:50 2022] DELETE /identity/v3/users/4a0b2f2c22ad413a995476d130ebd7f4 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:50.587652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:50.590815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:50.639340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a74c2-5019-471c-9fc8-abadbb54b924 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:50.765294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483a6cb-c664-4398-aa14-46005c75e68d admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:50.781334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:50.782940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:50.783489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:50.783993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] PATH_INFO: `/v3/users/94dd09861da3453088fa3caed87ae582` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:50.786379 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=94dd09861da3453088fa3caed87ae582)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:50.795240 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:50.801272 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:50.803882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:50.804338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:50.804792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] PATH_INFO: `/v3/users/387c8823a2c545689ea51df304b92bc6` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:50.808081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=387c8823a2c545689ea51df304b92bc6)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:50.814479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:50.867307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94dd09861da3453088fa3caed87ae582'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.868465 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94dd09861da3453088fa3caed87ae582'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.869834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94dd09861da3453088fa3caed87ae582'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.881777 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94dd09861da3453088fa3caed87ae582'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.912761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387c8823a2c545689ea51df304b92bc6'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.915367 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387c8823a2c545689ea51df304b92bc6'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.916626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387c8823a2c545689ea51df304b92bc6'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.917031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94dd09861da3453088fa3caed87ae582'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.954803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 977/1968] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:50 2022] DELETE /identity/v3/users/94dd09861da3453088fa3caed87ae582 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:50.963125 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:50.968970 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:50.971252 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387c8823a2c545689ea51df304b92bc6'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:50.999375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36c19bb8-877b-4a71-ac14-8b478ae1cedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387c8823a2c545689ea51df304b92bc6'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.063561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 992/1969] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:50 2022] DELETE /identity/v3/users/387c8823a2c545689ea51df304b92bc6 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:51.073263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe38c-af8d-4728-9b85-9c939852161e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:51.074905 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe38c-af8d-4728-9b85-9c939852161e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:51.075622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe38c-af8d-4728-9b85-9c939852161e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:51.101848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-901fe38c-af8d-4728-9b85-9c939852161e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:51.103143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-901fe38c-af8d-4728-9b85-9c939852161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:51.122862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b10393-e4ea-4380-bf5c-0d71777eec7f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:51.307465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 993/1970] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:51.308635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fe38c-af8d-4728-9b85-9c939852161e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:51.313637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-901fe38c-af8d-4728-9b85-9c939852161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:51.352207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:51.353311 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fe38c-af8d-4728-9b85-9c939852161e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:51.358319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:51.359662 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:51.360992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] PATH_INFO: `/v3/users/16182baab9ea45069a60d011788a4b7d` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:51.364473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:51.365319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:51.365622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:51.365906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] PATH_INFO: `/v3/projects/ff18ed419609462b9d7ed757b8ff9b14` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:51.366504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16182baab9ea45069a60d011788a4b7d)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:51.370750 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff18ed419609462b9d7ed757b8ff9b14)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:51.372850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:51.375856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:51.468926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16182baab9ea45069a60d011788a4b7d'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.469755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff18ed419609462b9d7ed757b8ff9b14', 'request_id': 'req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.470227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16182baab9ea45069a60d011788a4b7d'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.471320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16182baab9ea45069a60d011788a4b7d'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.478034 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff18ed419609462b9d7ed757b8ff9b14', 'request_id': 'req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.490768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16182baab9ea45069a60d011788a4b7d'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.491652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff18ed419609462b9d7ed757b8ff9b14', 'request_id': 'req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.520549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f6e350fc-8159-43ad-8c69-933e190c1065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16182baab9ea45069a60d011788a4b7d'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.528983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] The token cache is being invalidate because project ff18ed419609462b9d7ed757b8ff9b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:51.529777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.530541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.535986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 994/1971] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:51 2022] DELETE /identity/v3/projects/ff18ed419609462b9d7ed757b8ff9b14 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:51.535986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:51.535986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:51.562888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 978/1972] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:50 2022] DELETE /identity/v3/users/16182baab9ea45069a60d011788a4b7d => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:51.567018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293349a-326f-44c2-b045-98c2edb62f02 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:51.567423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293349a-326f-44c2-b045-98c2edb62f02 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:51.568230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293349a-326f-44c2-b045-98c2edb62f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:51.619330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-a293349a-326f-44c2-b045-98c2edb62f02 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:51.625267 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a293349a-326f-44c2-b045-98c2edb62f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:51.631858 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079ddc5-a94a-47a8-8661-cf53c26b0dfc admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:51.703920 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb7c96-95bc-4404-a7b7-7107473d817f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:51.704586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb7c96-95bc-4404-a7b7-7107473d817f service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:51.704868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb7c96-95bc-4404-a7b7-7107473d817f service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:51.705149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb7c96-95bc-4404-a7b7-7107473d817f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:51.707427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f0eb7c96-95bc-4404-a7b7-7107473d817f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:51.719976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 979/1973] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:51.721698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6df4-b408-441b-92c2-377e8caaa4fd None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:51.722091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6df4-b408-441b-92c2-377e8caaa4fd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:51.722460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e6df4-b408-441b-92c2-377e8caaa4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:51.743790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb7c96-95bc-4404-a7b7-7107473d817f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:51.745267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb7c96-95bc-4404-a7b7-7107473d817f service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:51.767700 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 995/1974] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:51.777895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-ad2e6df4-b408-441b-92c2-377e8caaa4fd None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:51.779681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ad2e6df4-b408-441b-92c2-377e8caaa4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:51.783992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb7c96-95bc-4404-a7b7-7107473d817f service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:51.793144 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f0eb7c96-95bc-4404-a7b7-7107473d817f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:51.810114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 980/1975] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:51.814431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6df4-b408-441b-92c2-377e8caaa4fd None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:51.816163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ad2e6df4-b408-441b-92c2-377e8caaa4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:51.830149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e6df4-b408-441b-92c2-377e8caaa4fd None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:51.846149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:51.850880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:51.855833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:51.856442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] PATH_INFO: `/v3/projects/664d7ea3954c47c0a02def366529823f` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:51.860209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=664d7ea3954c47c0a02def366529823f)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:51.862373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:51.914671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb7c96-95bc-4404-a7b7-7107473d817f service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:51.930222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664d7ea3954c47c0a02def366529823f', 'request_id': 'req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.938450 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664d7ea3954c47c0a02def366529823f', 'request_id': 'req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.951710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664d7ea3954c47c0a02def366529823f', 'request_id': 'req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.982228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] The token cache is being invalidate because project 664d7ea3954c47c0a02def366529823f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:51.982703 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.983990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8de5f0d0-d37c-4f49-a76a-98fbc48bbe21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:51.987798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30ebcd-4065-4ce8-b578-6a0c4efd7b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:51.988480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30ebcd-4065-4ce8-b578-6a0c4efd7b93 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:51.988763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30ebcd-4065-4ce8-b578-6a0c4efd7b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:51.989038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30ebcd-4065-4ce8-b578-6a0c4efd7b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:51.996734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 981/1976] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:51 2022] DELETE /identity/v3/projects/664d7ea3954c47c0a02def366529823f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:51.998737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9c30ebcd-4065-4ce8-b578-6a0c4efd7b93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:51.998892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6918145-f391-4687-b808-6c0f30f41baf None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:51.999311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6918145-f391-4687-b808-6c0f30f41baf None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.001072 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6918145-f391-4687-b808-6c0f30f41baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.024852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-a6918145-f391-4687-b808-6c0f30f41baf None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:52.026346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a6918145-f391-4687-b808-6c0f30f41baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:52.125225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 982/1977] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:52.126782 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6918145-f391-4687-b808-6c0f30f41baf None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:52.127637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30ebcd-4065-4ce8-b578-6a0c4efd7b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:52.128982 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a6918145-f391-4687-b808-6c0f30f41baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:52.129537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30ebcd-4065-4ce8-b578-6a0c4efd7b93 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:52.144690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 996/1978] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:52.146428 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c91a34-9c0d-45e1-aa74-1c72b1d172a3 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.146875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c91a34-9c0d-45e1-aa74-1c72b1d172a3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.147470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c91a34-9c0d-45e1-aa74-1c72b1d172a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.201729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e1c91a34-9c0d-45e1-aa74-1c72b1d172a3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:52.203561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e1c91a34-9c0d-45e1-aa74-1c72b1d172a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:52.215572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 997/1979] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:52.216558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c91a34-9c0d-45e1-aa74-1c72b1d172a3 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:52.228335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c91a34-9c0d-45e1-aa74-1c72b1d172a3 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:52.236057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1eb52-5f85-4db5-a932-23ef49fdaeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:52.236801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1eb52-5f85-4db5-a932-23ef49fdaeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.237096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1eb52-5f85-4db5-a932-23ef49fdaeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.237376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1eb52-5f85-4db5-a932-23ef49fdaeb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.238172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1eb52-5f85-4db5-a932-23ef49fdaeb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:52.238484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1eb52-5f85-4db5-a932-23ef49fdaeb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:52.241381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1eb52-5f85-4db5-a932-23ef49fdaeb6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:52.253031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6918145-f391-4687-b808-6c0f30f41baf None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:52.256720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 998/1980] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:52.258585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37744c3e-893c-41eb-b2f3-2543aeb766db None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.258585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37744c3e-893c-41eb-b2f3-2543aeb766db None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.258862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37744c3e-893c-41eb-b2f3-2543aeb766db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.262149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b5c2a-f1c7-44f4-bdb0-923f8c1c1b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:52.262998 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b5c2a-f1c7-44f4-bdb0-923f8c1c1b86 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.263379 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b5c2a-f1c7-44f4-bdb0-923f8c1c1b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.263753 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b5c2a-f1c7-44f4-bdb0-923f8c1c1b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.266813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2c3b5c2a-f1c7-44f4-bdb0-923f8c1c1b86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:52.279178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-37744c3e-893c-41eb-b2f3-2543aeb766db None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:52.280407 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-37744c3e-893c-41eb-b2f3-2543aeb766db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:52.285140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b5c2a-f1c7-44f4-bdb0-923f8c1c1b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:52.287387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b5c2a-f1c7-44f4-bdb0-923f8c1c1b86 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:52.290518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 999/1981] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:52.291237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37744c3e-893c-41eb-b2f3-2543aeb766db None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:52.303478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37744c3e-893c-41eb-b2f3-2543aeb766db None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:52.304085 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 983/1982] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:52.305826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b5c2a-f1c7-44f4-bdb0-923f8c1c1b86 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:52.310217 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6d4b-b7d9-451c-be9b-41171ac9e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:52.311000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6d4b-b7d9-451c-be9b-41171ac9e998 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.311363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6d4b-b7d9-451c-be9b-41171ac9e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.311717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a6d4b-b7d9-451c-be9b-41171ac9e998 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.312663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a6d4b-b7d9-451c-be9b-41171ac9e998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:52.314800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a6d4b-b7d9-451c-be9b-41171ac9e998 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:52.318566 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b5c2a-f1c7-44f4-bdb0-923f8c1c1b86 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:52.341265 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160dc84-2656-4fd3-b80a-ed117ac536ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:52.342244 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160dc84-2656-4fd3-b80a-ed117ac536ff admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.342599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160dc84-2656-4fd3-b80a-ed117ac536ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.342922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160dc84-2656-4fd3-b80a-ed117ac536ff admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.343904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160dc84-2656-4fd3-b80a-ed117ac536ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:52.344201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160dc84-2656-4fd3-b80a-ed117ac536ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:52.346621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160dc84-2656-4fd3-b80a-ed117ac536ff admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:52.360805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1000/1983] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:52 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:52.366838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6d4b-b7d9-451c-be9b-41171ac9e998 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:52.368426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 984/1984] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:52.376028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160dc84-2656-4fd3-b80a-ed117ac536ff admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:52.402290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160dc84-2656-4fd3-b80a-ed117ac536ff admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:52.482304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a6d4b-b7d9-451c-be9b-41171ac9e998 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:52.490715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752f0bf-a72e-4de0-bfe5-bf01542492c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:52.491750 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f0bf-a72e-4de0-bfe5-bf01542492c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.492278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f0bf-a72e-4de0-bfe5-bf01542492c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.492733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752f0bf-a72e-4de0-bfe5-bf01542492c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.493830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752f0bf-a72e-4de0-bfe5-bf01542492c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:52.499909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752f0bf-a72e-4de0-bfe5-bf01542492c6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:52.548072 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1001/1985] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:52 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:52.554107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752f0bf-a72e-4de0-bfe5-bf01542492c6 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:52.587297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752f0bf-a72e-4de0-bfe5-bf01542492c6 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:52.606775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8f636-9553-45c1-845b-2cfdca6856d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:52.608283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8f636-9553-45c1-845b-2cfdca6856d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.608583 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8f636-9553-45c1-845b-2cfdca6856d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.608899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8f636-9553-45c1-845b-2cfdca6856d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.610187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8f636-9553-45c1-845b-2cfdca6856d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:52.615077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1e578-359b-47f1-8027-b5296e1258d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:52.616337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1e578-359b-47f1-8027-b5296e1258d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.616509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8f636-9553-45c1-845b-2cfdca6856d6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:52.617417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1e578-359b-47f1-8027-b5296e1258d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.618023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d1e578-359b-47f1-8027-b5296e1258d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.619641 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1e578-359b-47f1-8027-b5296e1258d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:52.624515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d1e578-359b-47f1-8027-b5296e1258d6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:52.659245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1002/1986] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:55:52.659245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1e578-359b-47f1-8027-b5296e1258d6 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:52.671081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d8d1e578-359b-47f1-8027-b5296e1258d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:52.682350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 985/1987] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:52 2022] POST /identity/v3/projects => generated 373 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:52.683433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8f636-9553-45c1-845b-2cfdca6856d6 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:52.722219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d1e578-359b-47f1-8027-b5296e1258d6 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:52.843701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:52.844774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8f636-9553-45c1-845b-2cfdca6856d6 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:52.845279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.845720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.846512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] PATH_INFO: `/v3/projects/735b7b485fda441d822f8c3a128167fb` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.848347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=735b7b485fda441d822f8c3a128167fb)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:52.851049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:52.854494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b12fb0-c2a6-4f16-acb6-c8be14376ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:52.856108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b12fb0-c2a6-4f16-acb6-c8be14376ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:52.858031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b12fb0-c2a6-4f16-acb6-c8be14376ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:52.858341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b12fb0-c2a6-4f16-acb6-c8be14376ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:52.861696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b12fb0-c2a6-4f16-acb6-c8be14376ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:52.867793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b12fb0-c2a6-4f16-acb6-c8be14376ff7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:52.891295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 986/1988] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:52.892205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b12fb0-c2a6-4f16-acb6-c8be14376ff7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:52.927010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b12fb0-c2a6-4f16-acb6-c8be14376ff7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:52.942956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735b7b485fda441d822f8c3a128167fb', 'request_id': 'req-dc18dd4c-5581-4a38-a803-779ab0f0db0c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:52.960368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735b7b485fda441d822f8c3a128167fb', 'request_id': 'req-dc18dd4c-5581-4a38-a803-779ab0f0db0c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:52.995518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735b7b485fda441d822f8c3a128167fb', 'request_id': 'req-dc18dd4c-5581-4a38-a803-779ab0f0db0c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.015512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] The token cache is being invalidate because project 735b7b485fda441d822f8c3a128167fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:53.015512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.016685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.020430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1003/1989] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:52 2022] DELETE /identity/v3/projects/735b7b485fda441d822f8c3a128167fb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:53.023982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:53.028729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:53.054872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0bc37-2a8e-4642-8254-0f824b0a8d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:53.056039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0bc37-2a8e-4642-8254-0f824b0a8d00 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:53.057445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0bc37-2a8e-4642-8254-0f824b0a8d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:53.058433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0bc37-2a8e-4642-8254-0f824b0a8d00 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:53.060557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0bc37-2a8e-4642-8254-0f824b0a8d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:53.065702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0bc37-2a8e-4642-8254-0f824b0a8d00 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:53.106820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 987/1990] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:52 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:53.106820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0bc37-2a8e-4642-8254-0f824b0a8d00 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:53.112257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-14d0bc37-2a8e-4642-8254-0f824b0a8d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:53.149978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0bc37-2a8e-4642-8254-0f824b0a8d00 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:53.158918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:53.160598 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:53.161675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:53.162153 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] PATH_INFO: `/v3/users/79ad98d41a794906bd4281260915b898` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:53.164510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ad98d41a794906bd4281260915b898)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:53.168041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18dd4c-5581-4a38-a803-779ab0f0db0c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:53.168776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:53.178596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9667-3a39-43f2-b739-d660f9e1988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:53.179803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9667-3a39-43f2-b739-d660f9e1988c admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:53.182216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9667-3a39-43f2-b739-d660f9e1988c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:53.183482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9667-3a39-43f2-b739-d660f9e1988c admin admin] PATH_INFO: `/v3/projects/32bcf4e51e844a53ad928d54e197f321/users/f81b75defdfd4a3d8a130cfe03ae5a17/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:53.204128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c9667-3a39-43f2-b739-d660f9e1988c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bcf4e51e844a53ad928d54e197f321, user_id=f81b75defdfd4a3d8a130cfe03ae5a17, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:53.207559 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c9667-3a39-43f2-b739-d660f9e1988c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:53.230354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1004/1991] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:53 2022] PUT /identity/v3/projects/32bcf4e51e844a53ad928d54e197f321/users/f81b75defdfd4a3d8a130cfe03ae5a17/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:53.231547 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9667-3a39-43f2-b739-d660f9e1988c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:53.233504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e89c9667-3a39-43f2-b739-d660f9e1988c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:53.308639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ad98d41a794906bd4281260915b898'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.309609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ad98d41a794906bd4281260915b898'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.310497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ad98d41a794906bd4281260915b898'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.319182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ad98d41a794906bd4281260915b898'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.343514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ad98d41a794906bd4281260915b898'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.364078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 988/1992] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:53 2022] DELETE /identity/v3/users/79ad98d41a794906bd4281260915b898 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:53.365221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:53.377291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:53.413562 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9667-3a39-43f2-b739-d660f9e1988c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:53.575849 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:53.578649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:53.581111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db6314-45e1-4f37-8e42-e9de2c98656d admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:53.583385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:53.584228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] PATH_INFO: `/v3/projects/02901fddd19340588cdf37df18144bbf` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:53.588567 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=02901fddd19340588cdf37df18144bbf)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:53.593388 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:53.600863 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9bc2e5-fba6-49ab-8d03-c905245483b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:53.602576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc2e5-fba6-49ab-8d03-c905245483b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:53.603191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc2e5-fba6-49ab-8d03-c905245483b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:53.604032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bc2e5-fba6-49ab-8d03-c905245483b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:53.606218 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bc2e5-fba6-49ab-8d03-c905245483b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:53.611094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9bc2e5-fba6-49ab-8d03-c905245483b0 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:53.673894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 989/1993] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:53.676539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf8b4c-d28c-4707-a5f4-f5c5bfd501f8 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:53.677148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf8b4c-d28c-4707-a5f4-f5c5bfd501f8 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:53.677728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf8b4c-d28c-4707-a5f4-f5c5bfd501f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:53.689193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02901fddd19340588cdf37df18144bbf', 'request_id': 'req-51106ffd-d862-4dcc-92f7-d80f4289c1ce'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.701086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02901fddd19340588cdf37df18144bbf', 'request_id': 'req-51106ffd-d862-4dcc-92f7-d80f4289c1ce'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.716440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02901fddd19340588cdf37df18144bbf', 'request_id': 'req-51106ffd-d862-4dcc-92f7-d80f4289c1ce'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.739576 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] The token cache is being invalidate because project 02901fddd19340588cdf37df18144bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:53.739880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.740682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:53.742890 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1005/1994] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:53 2022] DELETE /identity/v3/projects/02901fddd19340588cdf37df18144bbf => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:53.743594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:53.744963 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:53.747936 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-60cf8b4c-d28c-4707-a5f4-f5c5bfd501f8 None None] MFA Rules not processed for user `f81b75defdfd4a3d8a130cfe03ae5a17`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:53.749328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-60cf8b4c-d28c-4707-a5f4-f5c5bfd501f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:53.835525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51106ffd-d862-4dcc-92f7-d80f4289c1ce admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:53.843948 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a6a55-449f-4b7b-8932-9e685b4201f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:53.844903 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a6a55-449f-4b7b-8932-9e685b4201f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:53.845269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a6a55-449f-4b7b-8932-9e685b4201f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:53.845650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a6a55-449f-4b7b-8932-9e685b4201f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:53.846522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a6a55-449f-4b7b-8932-9e685b4201f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:53.848737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a6a55-449f-4b7b-8932-9e685b4201f0 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:53.869832 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1006/1995] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:53.869832 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a6a55-449f-4b7b-8932-9e685b4201f0 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:53.882633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e89a6a55-449f-4b7b-8932-9e685b4201f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:53.921205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 990/1996] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:53.922171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf8b4c-d28c-4707-a5f4-f5c5bfd501f8 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:53.938682 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf8b4c-d28c-4707-a5f4-f5c5bfd501f8 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:53.946440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b581cd7-a9d5-4fe5-9a75-370cdaae9c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:53.947696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b581cd7-a9d5-4fe5-9a75-370cdaae9c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:53.948100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b581cd7-a9d5-4fe5-9a75-370cdaae9c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:53.948688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b581cd7-a9d5-4fe5-9a75-370cdaae9c8d admin admin] PATH_INFO: `/v3/projects/2b0c0cd6608449f4a5b15b57845a43f1/users/d31f2a616d9b450abf2fabf5fb9e26fc/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:53.955912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a6a55-449f-4b7b-8932-9e685b4201f0 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:53.971872 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:53.973147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:53.973540 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:53.973942 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] PATH_INFO: `/v3/users/e03f8dfbfb084933bee0a093d7b40d40` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:53.976362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03f8dfbfb084933bee0a093d7b40d40)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:53.982941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:53.986198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b581cd7-a9d5-4fe5-9a75-370cdaae9c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0c0cd6608449f4a5b15b57845a43f1, user_id=d31f2a616d9b450abf2fabf5fb9e26fc, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:54.006444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b581cd7-a9d5-4fe5-9a75-370cdaae9c8d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:54.062111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 991/1997] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:53 2022] PUT /identity/v3/projects/2b0c0cd6608449f4a5b15b57845a43f1/users/d31f2a616d9b450abf2fabf5fb9e26fc/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:54.069632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b581cd7-a9d5-4fe5-9a75-370cdaae9c8d admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:54.078283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0b581cd7-a9d5-4fe5-9a75-370cdaae9c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:54.124177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03f8dfbfb084933bee0a093d7b40d40'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:54.126122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03f8dfbfb084933bee0a093d7b40d40'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:54.129275 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03f8dfbfb084933bee0a093d7b40d40'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:54.161551 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03f8dfbfb084933bee0a093d7b40d40'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:54.171780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f1edb70b-f3ba-4230-8a0d-8fbb264e0a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03f8dfbfb084933bee0a093d7b40d40'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:54.195149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1007/1998] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:53 2022] DELETE /identity/v3/users/e03f8dfbfb084933bee0a093d7b40d40 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:54.197341 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23251b00-1dc4-47f0-9abb-9f1eb3c83098 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:54.197650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23251b00-1dc4-47f0-9abb-9f1eb3c83098 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:54.198112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23251b00-1dc4-47f0-9abb-9f1eb3c83098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:54.263722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b581cd7-a9d5-4fe5-9a75-370cdaae9c8d admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:54.264070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-23251b00-1dc4-47f0-9abb-9f1eb3c83098 None None] MFA Rules not processed for user `d31f2a616d9b450abf2fabf5fb9e26fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:54.264972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-23251b00-1dc4-47f0-9abb-9f1eb3c83098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:54.373944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e41d-b6fa-4ee9-9694-a16786659a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:54.374759 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e41d-b6fa-4ee9-9694-a16786659a96 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:54.375321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e41d-b6fa-4ee9-9694-a16786659a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:54.375601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647e41d-b6fa-4ee9-9694-a16786659a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:54.376506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647e41d-b6fa-4ee9-9694-a16786659a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:54.379554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647e41d-b6fa-4ee9-9694-a16786659a96 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:54.414266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 992/1999] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:54 2022] POST /identity/v3/projects => generated 379 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:54.415597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e41d-b6fa-4ee9-9694-a16786659a96 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:54.421238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0647e41d-b6fa-4ee9-9694-a16786659a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:54.428794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1008/2000] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:54.429783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23251b00-1dc4-47f0-9abb-9f1eb3c83098 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:54.432216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-23251b00-1dc4-47f0-9abb-9f1eb3c83098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:54.465931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23251b00-1dc4-47f0-9abb-9f1eb3c83098 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:54.539852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647e41d-b6fa-4ee9-9694-a16786659a96 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:54.550454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:54.551977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:54.552720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:54.553445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] PATH_INFO: `/v3/projects/cb421773d1334c2e978f8c29e033afe8` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:54.560367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb421773d1334c2e978f8c29e033afe8)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:54.566996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:54.629620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb29ecf-13ac-4242-b06a-d672a1f0309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:54.630806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb29ecf-13ac-4242-b06a-d672a1f0309d admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:54.631303 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb29ecf-13ac-4242-b06a-d672a1f0309d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:54.631812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb29ecf-13ac-4242-b06a-d672a1f0309d admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:54.634304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb29ecf-13ac-4242-b06a-d672a1f0309d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:54.640148 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb29ecf-13ac-4242-b06a-d672a1f0309d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:54.726910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1009/2001] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:54 2022] POST /identity/v3/users => generated 290 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:54.735707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb29ecf-13ac-4242-b06a-d672a1f0309d admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:54.740603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb421773d1334c2e978f8c29e033afe8', 'request_id': 'req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:54.743991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8fb29ecf-13ac-4242-b06a-d672a1f0309d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:54.754617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb421773d1334c2e978f8c29e033afe8', 'request_id': 'req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:54.773714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb421773d1334c2e978f8c29e033afe8', 'request_id': 'req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:54.795809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] The token cache is being invalidate because project cb421773d1334c2e978f8c29e033afe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:54.796099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:54.796820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:54.803633 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 993/2002] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:54 2022] DELETE /identity/v3/projects/cb421773d1334c2e978f8c29e033afe8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:54.804737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:54.807277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:54.929814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb29ecf-13ac-4242-b06a-d672a1f0309d admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:54.947533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e1c96-76bb-43ed-8ec7-c89808b5b05b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:54.954731 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af76fe-c759-49e8-966f-3b2e4bcd5546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:54.955435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af76fe-c759-49e8-966f-3b2e4bcd5546 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:54.955722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af76fe-c759-49e8-966f-3b2e4bcd5546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:54.956037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af76fe-c759-49e8-966f-3b2e4bcd5546 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:54.956876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af76fe-c759-49e8-966f-3b2e4bcd5546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:54.958679 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af76fe-c759-49e8-966f-3b2e4bcd5546 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:54.990097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 994/2003] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:54.990097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c817-3761-4e97-a98b-da9470affa5b None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:54.990097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c817-3761-4e97-a98b-da9470affa5b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:54.990097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86c817-3761-4e97-a98b-da9470affa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.054710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-8b86c817-3761-4e97-a98b-da9470affa5b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:55.061874 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8b86c817-3761-4e97-a98b-da9470affa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.073399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 995/2004] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:55.074755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86c817-3761-4e97-a98b-da9470affa5b None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:55.076154 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8b86c817-3761-4e97-a98b-da9470affa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.092635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca51d61-0300-4f88-af8f-b38688644cb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:55.093761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51d61-0300-4f88-af8f-b38688644cb1 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.094461 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51d61-0300-4f88-af8f-b38688644cb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.094969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca51d61-0300-4f88-af8f-b38688644cb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.097761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3ca51d61-0300-4f88-af8f-b38688644cb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.106898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86c817-3761-4e97-a98b-da9470affa5b None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:55.115283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:55.117611 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.118497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.119168 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] PATH_INFO: `/v3/projects/a6511058cbe34a4c804aa585c1959fb0` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.122505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6511058cbe34a4c804aa585c1959fb0)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:55.126389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:55.191115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6511058cbe34a4c804aa585c1959fb0', 'request_id': 'req-415612d8-2d36-450f-9552-fd2aa5d57582'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.201288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6511058cbe34a4c804aa585c1959fb0', 'request_id': 'req-415612d8-2d36-450f-9552-fd2aa5d57582'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.216585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca51d61-0300-4f88-af8f-b38688644cb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:55.216585 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca51d61-0300-4f88-af8f-b38688644cb1 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:55.220299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6511058cbe34a4c804aa585c1959fb0', 'request_id': 'req-415612d8-2d36-450f-9552-fd2aa5d57582'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.228082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1010/2005] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:55.231296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca51d61-0300-4f88-af8f-b38688644cb1 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:55.237422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] The token cache is being invalidate because project a6511058cbe34a4c804aa585c1959fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:55.237964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.239038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-415612d8-2d36-450f-9552-fd2aa5d57582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.243238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 996/2006] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:55 2022] DELETE /identity/v3/projects/a6511058cbe34a4c804aa585c1959fb0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:55.247428 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f1aec-b876-41e3-9cc1-58d637ebafa2 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.247684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f1aec-b876-41e3-9cc1-58d637ebafa2 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.248184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f1aec-b876-41e3-9cc1-58d637ebafa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.253729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca51d61-0300-4f88-af8f-b38688644cb1 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:55.286312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-1a6f1aec-b876-41e3-9cc1-58d637ebafa2 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:55.288728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1a6f1aec-b876-41e3-9cc1-58d637ebafa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.365973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcc5ca-0e2e-4889-b574-bec76e8d4d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:55.366896 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc5ca-0e2e-4889-b574-bec76e8d4d40 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.367345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc5ca-0e2e-4889-b574-bec76e8d4d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.367660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcc5ca-0e2e-4889-b574-bec76e8d4d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.368593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcc5ca-0e2e-4889-b574-bec76e8d4d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:55.371830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcc5ca-0e2e-4889-b574-bec76e8d4d40 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:55.389307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1011/2007] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:55.391379 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e611b-085f-4de8-a78b-7bbe40cf1f0d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.391811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e611b-085f-4de8-a78b-7bbe40cf1f0d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.392413 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e611b-085f-4de8-a78b-7bbe40cf1f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.403637 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 997/2008] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:55.407014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f1aec-b876-41e3-9cc1-58d637ebafa2 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:55.407014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1a6f1aec-b876-41e3-9cc1-58d637ebafa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.430494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-0a5e611b-085f-4de8-a78b-7bbe40cf1f0d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:55.433937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0a5e611b-085f-4de8-a78b-7bbe40cf1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.434709 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f1aec-b876-41e3-9cc1-58d637ebafa2 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:55.443234 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:55.444694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.445170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.445775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] PATH_INFO: `/v3/users/d31f2a616d9b450abf2fabf5fb9e26fc` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.448098 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31f2a616d9b450abf2fabf5fb9e26fc)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:55.449720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1012/2009] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:55.453211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e611b-085f-4de8-a78b-7bbe40cf1f0d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:55.455538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0a5e611b-085f-4de8-a78b-7bbe40cf1f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.464509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:55.490150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e611b-085f-4de8-a78b-7bbe40cf1f0d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:55.505799 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:55.507515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.507778 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.508192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] PATH_INFO: `/v3/users/f1e7e3d2858140888e9fcd33a4c234de` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.511568 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e7e3d2858140888e9fcd33a4c234de)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:55.524686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:55.541083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31f2a616d9b450abf2fabf5fb9e26fc'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.542821 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31f2a616d9b450abf2fabf5fb9e26fc'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.543617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31f2a616d9b450abf2fabf5fb9e26fc'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.562330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31f2a616d9b450abf2fabf5fb9e26fc'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.585091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31f2a616d9b450abf2fabf5fb9e26fc'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.601442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 998/2010] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:55 2022] DELETE /identity/v3/users/d31f2a616d9b450abf2fabf5fb9e26fc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:55.602493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:55.604222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.612548 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e7e3d2858140888e9fcd33a4c234de'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.613273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e7e3d2858140888e9fcd33a4c234de'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.613905 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e7e3d2858140888e9fcd33a4c234de'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.628035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e7e3d2858140888e9fcd33a4c234de'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.636637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e7e3d2858140888e9fcd33a4c234de'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:55.650926 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1013/2011] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:55 2022] DELETE /identity/v3/users/f1e7e3d2858140888e9fcd33a4c234de => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:55.652394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:55.653804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.684252 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10777ebe-b704-4fa9-a096-58762e588fa8 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:55.717472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac2922-ad17-4cf6-a7a2-2373691020e1 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:55.722391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe313d-65cf-4f89-876b-7e23c0c8594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:55.723069 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe313d-65cf-4f89-876b-7e23c0c8594e admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.723358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe313d-65cf-4f89-876b-7e23c0c8594e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.723639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe313d-65cf-4f89-876b-7e23c0c8594e admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.724587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe313d-65cf-4f89-876b-7e23c0c8594e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:55.724902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe313d-65cf-4f89-876b-7e23c0c8594e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:55.726575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe313d-65cf-4f89-876b-7e23c0c8594e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:55.739588 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1014/2012] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:55.741025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa49a0-76fd-46b6-bf56-00ee351f1418 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.741261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa49a0-76fd-46b6-bf56-00ee351f1418 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.741549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa49a0-76fd-46b6-bf56-00ee351f1418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.743760 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35ab98-7671-4951-8cff-6d62ef07c9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:55.744661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35ab98-7671-4951-8cff-6d62ef07c9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.744945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35ab98-7671-4951-8cff-6d62ef07c9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.746196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35ab98-7671-4951-8cff-6d62ef07c9d7 admin admin] PATH_INFO: `/v3/projects/640fd8b48fff4bfb87c089b9864e4c98/users/4e0bf0bfb13a446fa90cff484365abb4/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.760236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-00fa49a0-76fd-46b6-bf56-00ee351f1418 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:55.760579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35ab98-7671-4951-8cff-6d62ef07c9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=640fd8b48fff4bfb87c089b9864e4c98, user_id=4e0bf0bfb13a446fa90cff484365abb4, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:55.761753 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-00fa49a0-76fd-46b6-bf56-00ee351f1418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.763664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35ab98-7671-4951-8cff-6d62ef07c9d7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:55.770226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1015/2013] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:55.771558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271d315-79df-4eee-b983-c86dfa8aee07 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.771845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271d315-79df-4eee-b983-c86dfa8aee07 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.772118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271d315-79df-4eee-b983-c86dfa8aee07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.779272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 999/2014] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:55 2022] PUT /identity/v3/projects/640fd8b48fff4bfb87c089b9864e4c98/users/4e0bf0bfb13a446fa90cff484365abb4/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:55.780653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a16f7-c68f-488d-8d5c-eb26109c4afe None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.780969 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a16f7-c68f-488d-8d5c-eb26109c4afe None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.781399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a16f7-c68f-488d-8d5c-eb26109c4afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.791769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b271d315-79df-4eee-b983-c86dfa8aee07 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:55.793543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b271d315-79df-4eee-b983-c86dfa8aee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.806900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-1e4a16f7-c68f-488d-8d5c-eb26109c4afe None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:55.808266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1e4a16f7-c68f-488d-8d5c-eb26109c4afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.852660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1016/2015] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:55.853518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271d315-79df-4eee-b983-c86dfa8aee07 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:55.863023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271d315-79df-4eee-b983-c86dfa8aee07 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:55.867572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf63c17-959b-43ee-a75f-df3961690f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:55.868071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1000/2016] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:55.868271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf63c17-959b-43ee-a75f-df3961690f8c admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.868539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf63c17-959b-43ee-a75f-df3961690f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.868765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf63c17-959b-43ee-a75f-df3961690f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.868944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a16f7-c68f-488d-8d5c-eb26109c4afe None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:55.869448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf63c17-959b-43ee-a75f-df3961690f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:55.871645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf63c17-959b-43ee-a75f-df3961690f8c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:55.880865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a16f7-c68f-488d-8d5c-eb26109c4afe None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:55.886244 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a03242-975f-41ec-8352-487c58991ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:55.886970 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a03242-975f-41ec-8352-487c58991ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.887247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a03242-975f-41ec-8352-487c58991ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.887626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a03242-975f-41ec-8352-487c58991ce4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.888358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a03242-975f-41ec-8352-487c58991ce4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:55.888661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a03242-975f-41ec-8352-487c58991ce4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:55.890401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a03242-975f-41ec-8352-487c58991ce4 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:55.899770 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1017/2017] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:55 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:55.903260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1001/2018] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:55.906693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f34bc4-35d6-402f-8992-39d0a71bf803 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.906811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf63c17-959b-43ee-a75f-df3961690f8c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:55.906916 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f34bc4-35d6-402f-8992-39d0a71bf803 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.906916 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f34bc4-35d6-402f-8992-39d0a71bf803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:55.907095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-dcf63c17-959b-43ee-a75f-df3961690f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.932372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-15f34bc4-35d6-402f-8992-39d0a71bf803 None None] MFA Rules not processed for user `4e0bf0bfb13a446fa90cff484365abb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:55.934205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-15f34bc4-35d6-402f-8992-39d0a71bf803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:55.967104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf63c17-959b-43ee-a75f-df3961690f8c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:55.974725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96331be-ea15-42ba-9c50-18fdc136b727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:55.975538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96331be-ea15-42ba-9c50-18fdc136b727 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:55.976002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96331be-ea15-42ba-9c50-18fdc136b727 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:55.976838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96331be-ea15-42ba-9c50-18fdc136b727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.013272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1002/2019] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:56.014250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f34bc4-35d6-402f-8992-39d0a71bf803 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.018254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-15f34bc4-35d6-402f-8992-39d0a71bf803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:56.044775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f34bc4-35d6-402f-8992-39d0a71bf803 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.051710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a196a-ebd0-4da8-a059-518fcf86c6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.052387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a196a-ebd0-4da8-a059-518fcf86c6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.052670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a196a-ebd0-4da8-a059-518fcf86c6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.053100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a196a-ebd0-4da8-a059-518fcf86c6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.083524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96331be-ea15-42ba-9c50-18fdc136b727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.085016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96331be-ea15-42ba-9c50-18fdc136b727 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.104119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1018/2020] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:56.106322 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96331be-ea15-42ba-9c50-18fdc136b727 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.120581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96331be-ea15-42ba-9c50-18fdc136b727 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.128971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e1530-6927-4228-b645-c9cd6de0a103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.141751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e1530-6927-4228-b645-c9cd6de0a103 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.142749 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e1530-6927-4228-b645-c9cd6de0a103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.144578 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e1530-6927-4228-b645-c9cd6de0a103 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.145465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e1530-6927-4228-b645-c9cd6de0a103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.148554 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e1530-6927-4228-b645-c9cd6de0a103 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.176174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a196a-ebd0-4da8-a059-518fcf86c6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.180618 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1019/2021] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:56 2022] POST /identity/v3/users => generated 295 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:56.183835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e1530-6927-4228-b645-c9cd6de0a103 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.185528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a196a-ebd0-4da8-a059-518fcf86c6b2 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.210522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e1530-6927-4228-b645-c9cd6de0a103 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.216273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1003/2022] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:56.216989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2e55-4430-4bd8-815d-9bcefe40c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.217489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a196a-ebd0-4da8-a059-518fcf86c6b2 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.218421 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2e55-4430-4bd8-815d-9bcefe40c28a admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.218931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2e55-4430-4bd8-815d-9bcefe40c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.219356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a2e55-4430-4bd8-815d-9bcefe40c28a admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.220425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a2e55-4430-4bd8-815d-9bcefe40c28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.222929 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a2e55-4430-4bd8-815d-9bcefe40c28a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.224945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bc8a196a-ebd0-4da8-a059-518fcf86c6b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:56.253905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a196a-ebd0-4da8-a059-518fcf86c6b2 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.265775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199e2ee-d777-4162-b16d-b94891a8548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.266533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199e2ee-d777-4162-b16d-b94891a8548b admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.266829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199e2ee-d777-4162-b16d-b94891a8548b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.267118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199e2ee-d777-4162-b16d-b94891a8548b admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.268079 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199e2ee-d777-4162-b16d-b94891a8548b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.271364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199e2ee-d777-4162-b16d-b94891a8548b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.302603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1020/2023] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:56 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:56.302603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2e55-4430-4bd8-815d-9bcefe40c28a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.340208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1004/2024] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:56 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:56.340208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199e2ee-d777-4162-b16d-b94891a8548b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.470833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199e2ee-d777-4162-b16d-b94891a8548b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.480062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582be6-e3b3-4dd0-88c3-d2fad7f78bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.480809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582be6-e3b3-4dd0-88c3-d2fad7f78bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.481133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582be6-e3b3-4dd0-88c3-d2fad7f78bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.481845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582be6-e3b3-4dd0-88c3-d2fad7f78bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.483563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582be6-e3b3-4dd0-88c3-d2fad7f78bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.486472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582be6-e3b3-4dd0-88c3-d2fad7f78bd2 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.530766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a2e55-4430-4bd8-815d-9bcefe40c28a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.542430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1005/2025] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:56 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:56.543515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4668fc1-8700-4a17-a342-78d2a11e6c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.544762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668fc1-8700-4a17-a342-78d2a11e6c8d admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.545407 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668fc1-8700-4a17-a342-78d2a11e6c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.545726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668fc1-8700-4a17-a342-78d2a11e6c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.546425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582be6-e3b3-4dd0-88c3-d2fad7f78bd2 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.549077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4668fc1-8700-4a17-a342-78d2a11e6c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.550985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4668fc1-8700-4a17-a342-78d2a11e6c8d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.576985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1021/2026] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:56.578149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4668fc1-8700-4a17-a342-78d2a11e6c8d admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.586193 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582be6-e3b3-4dd0-88c3-d2fad7f78bd2 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.592557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52299a90-2ddc-4191-905f-0521c8b132e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.593197 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4668fc1-8700-4a17-a342-78d2a11e6c8d admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.593534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52299a90-2ddc-4191-905f-0521c8b132e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.593925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52299a90-2ddc-4191-905f-0521c8b132e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.594276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52299a90-2ddc-4191-905f-0521c8b132e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.595165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52299a90-2ddc-4191-905f-0521c8b132e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.597398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52299a90-2ddc-4191-905f-0521c8b132e2 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.598707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411e48-742b-4321-b81c-e87e82742818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.599458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411e48-742b-4321-b81c-e87e82742818 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.599797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411e48-742b-4321-b81c-e87e82742818 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.600083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411e48-742b-4321-b81c-e87e82742818 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.600823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68411e48-742b-4321-b81c-e87e82742818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.602479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68411e48-742b-4321-b81c-e87e82742818 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.616696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1022/2027] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:56.617660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411e48-742b-4321-b81c-e87e82742818 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.619913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-68411e48-742b-4321-b81c-e87e82742818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:56.635137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411e48-742b-4321-b81c-e87e82742818 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.641536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.642448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.642735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.643018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] PATH_INFO: `/v3/projects/2b0c0cd6608449f4a5b15b57845a43f1` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.644248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0c0cd6608449f4a5b15b57845a43f1)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.645125 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1006/2028] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:56 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:56.646149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52299a90-2ddc-4191-905f-0521c8b132e2 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.646389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.658762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52299a90-2ddc-4191-905f-0521c8b132e2 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.663584 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aafc12-e9a6-472e-b9ec-107222087d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.664293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aafc12-e9a6-472e-b9ec-107222087d8b admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.664743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aafc12-e9a6-472e-b9ec-107222087d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.665026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aafc12-e9a6-472e-b9ec-107222087d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.665839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aafc12-e9a6-472e-b9ec-107222087d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.668387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aafc12-e9a6-472e-b9ec-107222087d8b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.679980 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1007/2029] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:56.685114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aafc12-e9a6-472e-b9ec-107222087d8b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.694904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aafc12-e9a6-472e-b9ec-107222087d8b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.706686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0c0cd6608449f4a5b15b57845a43f1', 'request_id': 'req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:56.717409 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0c0cd6608449f4a5b15b57845a43f1', 'request_id': 'req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:56.728979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0c0cd6608449f4a5b15b57845a43f1', 'request_id': 'req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:56.742639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] The token cache is being invalidate because project 2b0c0cd6608449f4a5b15b57845a43f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:56.743305 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:56.744940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:56.748223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1023/2030] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:56 2022] DELETE /identity/v3/projects/2b0c0cd6608449f4a5b15b57845a43f1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:56.749172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.751879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:56.763392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b933-0ffa-49ee-ad6f-af6b1e3b1195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.764339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b933-0ffa-49ee-ad6f-af6b1e3b1195 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.764621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b933-0ffa-49ee-ad6f-af6b1e3b1195 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.764900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b933-0ffa-49ee-ad6f-af6b1e3b1195 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.765715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323b933-0ffa-49ee-ad6f-af6b1e3b1195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.768411 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323b933-0ffa-49ee-ad6f-af6b1e3b1195 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.781002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1008/2031] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:56.782584 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b933-0ffa-49ee-ad6f-af6b1e3b1195 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.785641 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7323b933-0ffa-49ee-ad6f-af6b1e3b1195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:56.801212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b933-0ffa-49ee-ad6f-af6b1e3b1195 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.806316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ef9b8-147c-447f-959d-50813328e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.807227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef9b8-147c-447f-959d-50813328e0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.807512 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef9b8-147c-447f-959d-50813328e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.807830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ef9b8-147c-447f-959d-50813328e0c8 admin admin] PATH_INFO: `/v3/projects/fbed4de3b3bd49f4ac53c84d1d4d75ee/users/b67a6fdf95374642a81d4c9d143c8dd1/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.838342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d80a6f-a2c0-4361-bc5c-992ae24ffdf1 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:56.839324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ef9b8-147c-447f-959d-50813328e0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbed4de3b3bd49f4ac53c84d1d4d75ee, user_id=b67a6fdf95374642a81d4c9d143c8dd1, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.842394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ef9b8-147c-447f-959d-50813328e0c8 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.847480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada687e-7857-40a7-b56c-0c99825fc754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:56.848728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada687e-7857-40a7-b56c-0c99825fc754 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.849259 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada687e-7857-40a7-b56c-0c99825fc754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.849800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada687e-7857-40a7-b56c-0c99825fc754 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.850853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada687e-7857-40a7-b56c-0c99825fc754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:56.852927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada687e-7857-40a7-b56c-0c99825fc754 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:56.871505 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1024/2032] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:56.873158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ecfeb-f29c-43d8-b05e-04d79f979036 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:56.873838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ecfeb-f29c-43d8-b05e-04d79f979036 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:56.874235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ecfeb-f29c-43d8-b05e-04d79f979036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:56.883149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1009/2033] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:56 2022] PUT /identity/v3/projects/fbed4de3b3bd49f4ac53c84d1d4d75ee/users/b67a6fdf95374642a81d4c9d143c8dd1/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:56.884206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ef9b8-147c-447f-959d-50813328e0c8 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:56.890881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-283ef9b8-147c-447f-959d-50813328e0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:56.902754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-da0ecfeb-f29c-43d8-b05e-04d79f979036 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:56.903996 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-da0ecfeb-f29c-43d8-b05e-04d79f979036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:56.985658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1025/2034] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:56.993371 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ecfeb-f29c-43d8-b05e-04d79f979036 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:57.007235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ecfeb-f29c-43d8-b05e-04d79f979036 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.011738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f3ad6-a3c8-4cbb-a6a9-09ad9a2aa68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:57.012697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f3ad6-a3c8-4cbb-a6a9-09ad9a2aa68b admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.012999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f3ad6-a3c8-4cbb-a6a9-09ad9a2aa68b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.013276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f3ad6-a3c8-4cbb-a6a9-09ad9a2aa68b admin admin] PATH_INFO: `/v3/projects/b6dba07a79af4a229e00af26d89351b5/users/aa27daf998904db784dd2110f8274285/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.031647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f3ad6-a3c8-4cbb-a6a9-09ad9a2aa68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dba07a79af4a229e00af26d89351b5, user_id=aa27daf998904db784dd2110f8274285, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:57.034637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f3ad6-a3c8-4cbb-a6a9-09ad9a2aa68b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:57.052696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1026/2035] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:56 2022] PUT /identity/v3/projects/b6dba07a79af4a229e00af26d89351b5/users/aa27daf998904db784dd2110f8274285/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:57.055229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1ef46-ecbd-439e-84ff-c64cc75dc098 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.055595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1ef46-ecbd-439e-84ff-c64cc75dc098 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.055824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1ef46-ecbd-439e-84ff-c64cc75dc098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.055965 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ef9b8-147c-447f-959d-50813328e0c8 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.096961 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-84f1ef46-ecbd-439e-84ff-c64cc75dc098 None None] MFA Rules not processed for user `b67a6fdf95374642a81d4c9d143c8dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:57.098532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-84f1ef46-ecbd-439e-84ff-c64cc75dc098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:57.162910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e041db-93c0-41a5-b036-eef91bb173f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:57.164065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e041db-93c0-41a5-b036-eef91bb173f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.165063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e041db-93c0-41a5-b036-eef91bb173f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.165498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e041db-93c0-41a5-b036-eef91bb173f6 admin admin] PATH_INFO: `/v3/projects/dc82edc38ad346b9a571cc24031c4fcb/users/8184cbc4128c4025bfa88223b1bb028a/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.203026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e041db-93c0-41a5-b036-eef91bb173f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc82edc38ad346b9a571cc24031c4fcb, user_id=8184cbc4128c4025bfa88223b1bb028a, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:57.206117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e041db-93c0-41a5-b036-eef91bb173f6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:57.225014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1010/2036] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:56 2022] PUT /identity/v3/projects/dc82edc38ad346b9a571cc24031c4fcb/users/8184cbc4128c4025bfa88223b1bb028a/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:57.226751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485ad2b-5f23-4d14-b3ab-b70933c1c4bc None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.227260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485ad2b-5f23-4d14-b3ab-b70933c1c4bc None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.227770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485ad2b-5f23-4d14-b3ab-b70933c1c4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.235590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1027/2037] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:57.238384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1ef46-ecbd-439e-84ff-c64cc75dc098 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:57.252305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e485ad2b-5f23-4d14-b3ab-b70933c1c4bc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:57.255046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e485ad2b-5f23-4d14-b3ab-b70933c1c4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:57.256399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1ef46-ecbd-439e-84ff-c64cc75dc098 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.358177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1011/2038] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:57.358177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485ad2b-5f23-4d14-b3ab-b70933c1c4bc None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:57.358177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e485ad2b-5f23-4d14-b3ab-b70933c1c4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:57.376558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a6cf7-a7b9-48a7-b83e-9fa24346e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:57.377614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a6cf7-a7b9-48a7-b83e-9fa24346e50f admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.378223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a6cf7-a7b9-48a7-b83e-9fa24346e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.378346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485ad2b-5f23-4d14-b3ab-b70933c1c4bc None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.378814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a6cf7-a7b9-48a7-b83e-9fa24346e50f admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.381471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a6cf7-a7b9-48a7-b83e-9fa24346e50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:57.383461 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a6cf7-a7b9-48a7-b83e-9fa24346e50f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:57.393402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:57.394384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.394675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.394958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] PATH_INFO: `/v3/projects/7390875b2b0d455bbc4b8e3b0ce20912` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.400788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1028/2039] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:57.404729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7390875b2b0d455bbc4b8e3b0ce20912)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:57.404729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:57.406124 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a6cf7-a7b9-48a7-b83e-9fa24346e50f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:57.420988 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a6cf7-a7b9-48a7-b83e-9fa24346e50f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.430851 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a0a7d-f153-48c2-91a2-5f048290f480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:57.433094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0a7d-f153-48c2-91a2-5f048290f480 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.434225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0a7d-f153-48c2-91a2-5f048290f480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.434745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a0a7d-f153-48c2-91a2-5f048290f480 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.435883 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a0a7d-f153-48c2-91a2-5f048290f480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:57.439162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a0a7d-f153-48c2-91a2-5f048290f480 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:57.473974 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7390875b2b0d455bbc4b8e3b0ce20912', 'request_id': 'req-1f534654-4b54-47c4-9754-e112d2003465'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:57.482454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7390875b2b0d455bbc4b8e3b0ce20912', 'request_id': 'req-1f534654-4b54-47c4-9754-e112d2003465'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:57.493459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1029/2040] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:57 2022] POST /identity/v3/projects => generated 389 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:57.496250 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae07c8-beef-4b2e-bd4b-d09c84d03ecb None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.496543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae07c8-beef-4b2e-bd4b-d09c84d03ecb None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.496820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae07c8-beef-4b2e-bd4b-d09c84d03ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.511919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7390875b2b0d455bbc4b8e3b0ce20912', 'request_id': 'req-1f534654-4b54-47c4-9754-e112d2003465'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:57.524210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] The token cache is being invalidate because project 7390875b2b0d455bbc4b8e3b0ce20912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:57.524802 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:57.526117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:57.527680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-52ae07c8-beef-4b2e-bd4b-d09c84d03ecb None None] MFA Rules not processed for user `8184cbc4128c4025bfa88223b1bb028a`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:57.528529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1012/2041] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:57 2022] DELETE /identity/v3/projects/7390875b2b0d455bbc4b8e3b0ce20912 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:57.528937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-52ae07c8-beef-4b2e-bd4b-d09c84d03ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:57.529745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:57.531287 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:57.601966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1030/2042] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:57.602871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae07c8-beef-4b2e-bd4b-d09c84d03ecb None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:57.604265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-52ae07c8-beef-4b2e-bd4b-d09c84d03ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:57.621992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f534654-4b54-47c4-9754-e112d2003465 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.684707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfcd47-12bc-4b23-8e38-e606bc0fd635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:57.685516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfcd47-12bc-4b23-8e38-e606bc0fd635 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.685845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfcd47-12bc-4b23-8e38-e606bc0fd635 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.686234 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfcd47-12bc-4b23-8e38-e606bc0fd635 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.686899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfcd47-12bc-4b23-8e38-e606bc0fd635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:55:57.687700 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfcd47-12bc-4b23-8e38-e606bc0fd635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:57.689178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfcd47-12bc-4b23-8e38-e606bc0fd635 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:57.694488 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae07c8-beef-4b2e-bd4b-d09c84d03ecb None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.700825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a6336-57d1-41f4-831e-cb90097a2ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:57.701917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a6336-57d1-41f4-831e-cb90097a2ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.702198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a6336-57d1-41f4-831e-cb90097a2ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.702485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1013/2043] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:55:57.703315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfcd47-12bc-4b23-8e38-e606bc0fd635 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:57.706063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a6336-57d1-41f4-831e-cb90097a2ec9 admin admin] PATH_INFO: `/v3/projects/b6dba07a79af4a229e00af26d89351b5/users/aa27daf998904db784dd2110f8274285/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.707227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f3cfcd47-12bc-4b23-8e38-e606bc0fd635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:57.708351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a6336-57d1-41f4-831e-cb90097a2ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6dba07a79af4a229e00af26d89351b5, user_id=aa27daf998904db784dd2110f8274285, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:57.711707 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a6336-57d1-41f4-831e-cb90097a2ec9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:57.721025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfcd47-12bc-4b23-8e38-e606bc0fd635 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.733438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1031/2044] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:57 2022] PUT /identity/v3/projects/b6dba07a79af4a229e00af26d89351b5/users/aa27daf998904db784dd2110f8274285/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:57.733438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a6336-57d1-41f4-831e-cb90097a2ec9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:57.735460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-579a6336-57d1-41f4-831e-cb90097a2ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:57.790225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d00da7-985b-460d-bfc5-375465ef7a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:57.790904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d00da7-985b-460d-bfc5-375465ef7a9a admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.791183 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d00da7-985b-460d-bfc5-375465ef7a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.791456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d00da7-985b-460d-bfc5-375465ef7a9a admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.792872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d00da7-985b-460d-bfc5-375465ef7a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:57.795436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d00da7-985b-460d-bfc5-375465ef7a9a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:57.804091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a6336-57d1-41f4-831e-cb90097a2ec9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.810370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:57.811329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.811651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.811868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] PATH_INFO: `/v3/users/db761e870e1543dea9c766ee198b17d7` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.813101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db761e870e1543dea9c766ee198b17d7)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:57.815059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:57.829347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1014/2045] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:57 2022] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:57.830200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d00da7-985b-460d-bfc5-375465ef7a9a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:57.831862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-87d00da7-985b-460d-bfc5-375465ef7a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:57.844091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d00da7-985b-460d-bfc5-375465ef7a9a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.849605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ee1fa-204a-4a5c-9bc2-d63aafc4a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:57.850053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ee1fa-204a-4a5c-9bc2-d63aafc4a571 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.850333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ee1fa-204a-4a5c-9bc2-d63aafc4a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.850601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ee1fa-204a-4a5c-9bc2-d63aafc4a571 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.851290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ee1fa-204a-4a5c-9bc2-d63aafc4a571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:57.853216 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ee1fa-204a-4a5c-9bc2-d63aafc4a571 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:57.884898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1015/2046] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:57 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:57.889442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ee1fa-204a-4a5c-9bc2-d63aafc4a571 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:57.892559 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db761e870e1543dea9c766ee198b17d7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:57.893391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db761e870e1543dea9c766ee198b17d7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:57.894035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db761e870e1543dea9c766ee198b17d7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:57.907308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db761e870e1543dea9c766ee198b17d7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:57.917712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-add2a9d5-2cac-4267-95bf-46d2baaf2df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db761e870e1543dea9c766ee198b17d7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:57.930595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1032/2047] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:57 2022] DELETE /identity/v3/users/db761e870e1543dea9c766ee198b17d7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:57.932106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a44c1c-79b6-4389-b2dd-f27099c06f0b None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:57.932481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a44c1c-79b6-4389-b2dd-f27099c06f0b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:57.933953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a44c1c-79b6-4389-b2dd-f27099c06f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:57.963136 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ee1fa-204a-4a5c-9bc2-d63aafc4a571 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:57.973468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-51a44c1c-79b6-4389-b2dd-f27099c06f0b None None] MFA Rules not processed for user `aa27daf998904db784dd2110f8274285`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:57.975617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-51a44c1c-79b6-4389-b2dd-f27099c06f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.055476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9ef42-e7df-4fc8-ab6b-0c3866fb98dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.056513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ef42-e7df-4fc8-ab6b-0c3866fb98dc admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.057440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ef42-e7df-4fc8-ab6b-0c3866fb98dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.058830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ef42-e7df-4fc8-ab6b-0c3866fb98dc admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.059774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9ef42-e7df-4fc8-ab6b-0c3866fb98dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.062344 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea9ef42-e7df-4fc8-ab6b-0c3866fb98dc admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.088476 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1033/2048] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:58.094667 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a44c1c-79b6-4389-b2dd-f27099c06f0b None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.103311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1016/2049] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:55:57 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:58.103311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9ef42-e7df-4fc8-ab6b-0c3866fb98dc admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.103681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-51a44c1c-79b6-4389-b2dd-f27099c06f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.103761 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-dea9ef42-e7df-4fc8-ab6b-0c3866fb98dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.127622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a44c1c-79b6-4389-b2dd-f27099c06f0b None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.193888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9ef42-e7df-4fc8-ab6b-0c3866fb98dc admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.198904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2194a-7c99-4d47-b066-2870b97c7e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.199772 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2194a-7c99-4d47-b066-2870b97c7e56 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.200120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2194a-7c99-4d47-b066-2870b97c7e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.200464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2194a-7c99-4d47-b066-2870b97c7e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.201315 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2194a-7c99-4d47-b066-2870b97c7e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.204071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c0fb-fbdd-4754-8ef3-81b97ae05464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.204996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c0fb-fbdd-4754-8ef3-81b97ae05464 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.205384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2194a-7c99-4d47-b066-2870b97c7e56 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.205671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c0fb-fbdd-4754-8ef3-81b97ae05464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.206121 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1c0fb-fbdd-4754-8ef3-81b97ae05464 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.207017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1c0fb-fbdd-4754-8ef3-81b97ae05464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.209229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1c0fb-fbdd-4754-8ef3-81b97ae05464 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.221976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1034/2050] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:58.222729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2194a-7c99-4d47-b066-2870b97c7e56 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.228563 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-eac2194a-7c99-4d47-b066-2870b97c7e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.239089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1017/2051] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:58 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:58.240049 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c0fb-fbdd-4754-8ef3-81b97ae05464 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.243243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-76e1c0fb-fbdd-4754-8ef3-81b97ae05464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.252830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2194a-7c99-4d47-b066-2870b97c7e56 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.270572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e46cb-2fe6-444f-b08d-9d91a55823b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.271264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e46cb-2fe6-444f-b08d-9d91a55823b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.271590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e46cb-2fe6-444f-b08d-9d91a55823b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.271856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e46cb-2fe6-444f-b08d-9d91a55823b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.272694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e46cb-2fe6-444f-b08d-9d91a55823b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.274586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e46cb-2fe6-444f-b08d-9d91a55823b8 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.307042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1035/2052] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:55:58 2022] POST /identity/v3/users => generated 287 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:55:58.310476 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e46cb-2fe6-444f-b08d-9d91a55823b8 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.317515 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1c0fb-fbdd-4754-8ef3-81b97ae05464 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.321694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957cc9-dd65-4f27-a9e3-dfc2fd72d680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.322369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957cc9-dd65-4f27-a9e3-dfc2fd72d680 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.322750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957cc9-dd65-4f27-a9e3-dfc2fd72d680 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.322910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957cc9-dd65-4f27-a9e3-dfc2fd72d680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.325230 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e46cb-2fe6-444f-b08d-9d91a55823b8 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.331681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed47a6c-04b8-47f3-b65d-c8ac6a05fbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.332596 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed47a6c-04b8-47f3-b65d-c8ac6a05fbb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.332879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed47a6c-04b8-47f3-b65d-c8ac6a05fbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.333153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed47a6c-04b8-47f3-b65d-c8ac6a05fbb8 admin admin] PATH_INFO: `/v3/projects/7b6a8c0b89384d04aaddb77a78efcacf/users/9474a53f94db4c66a18202a9b46c3279/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.352694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed47a6c-04b8-47f3-b65d-c8ac6a05fbb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6a8c0b89384d04aaddb77a78efcacf, user_id=9474a53f94db4c66a18202a9b46c3279, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.356304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed47a6c-04b8-47f3-b65d-c8ac6a05fbb8 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.371700 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1036/2053] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:58 2022] PUT /identity/v3/projects/7b6a8c0b89384d04aaddb77a78efcacf/users/9474a53f94db4c66a18202a9b46c3279/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:58.375485 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed47a6c-04b8-47f3-b65d-c8ac6a05fbb8 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.407371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957cc9-dd65-4f27-a9e3-dfc2fd72d680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.409601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957cc9-dd65-4f27-a9e3-dfc2fd72d680 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.436840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1018/2054] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:58.438674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957cc9-dd65-4f27-a9e3-dfc2fd72d680 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.440363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b5957cc9-dd65-4f27-a9e3-dfc2fd72d680 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.447809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed47a6c-04b8-47f3-b65d-c8ac6a05fbb8 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.455483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df166124-143a-4743-9a32-458b5a899ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.456612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df166124-143a-4743-9a32-458b5a899ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.456996 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df166124-143a-4743-9a32-458b5a899ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.457277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df166124-143a-4743-9a32-458b5a899ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.458277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957cc9-dd65-4f27-a9e3-dfc2fd72d680 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.458537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df166124-143a-4743-9a32-458b5a899ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.460965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df166124-143a-4743-9a32-458b5a899ad5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.465142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.466084 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.466474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.466815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] PATH_INFO: `/v3/projects/2900e624367443a28281ca40a75490f0` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.468769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2900e624367443a28281ca40a75490f0)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.471796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.477836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1037/2055] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:58.477836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df166124-143a-4743-9a32-458b5a899ad5 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.488805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df166124-143a-4743-9a32-458b5a899ad5 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.493745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ae7da-e84b-4ba6-812b-bf6e02020362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.494417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae7da-e84b-4ba6-812b-bf6e02020362 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.494702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae7da-e84b-4ba6-812b-bf6e02020362 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.494997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ae7da-e84b-4ba6-812b-bf6e02020362 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.495975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ae7da-e84b-4ba6-812b-bf6e02020362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.497526 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ae7da-e84b-4ba6-812b-bf6e02020362 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.508442 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1038/2056] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:58.509403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ae7da-e84b-4ba6-812b-bf6e02020362 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.520096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ae7da-e84b-4ba6-812b-bf6e02020362 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.534681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2900e624367443a28281ca40a75490f0', 'request_id': 'req-f2c7acb1-6d8b-4518-b021-5b75624eac99'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:58.543686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2900e624367443a28281ca40a75490f0', 'request_id': 'req-f2c7acb1-6d8b-4518-b021-5b75624eac99'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:58.552181 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2900e624367443a28281ca40a75490f0', 'request_id': 'req-f2c7acb1-6d8b-4518-b021-5b75624eac99'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:58.564437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] The token cache is being invalidate because project 2900e624367443a28281ca40a75490f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:55:58.564725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:58.565407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:58.569714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1019/2057] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:58 2022] DELETE /identity/v3/projects/2900e624367443a28281ca40a75490f0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:58.570858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.572345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.588544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af4253-da8c-497b-8199-19f8ccfc3ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.590463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af4253-da8c-497b-8199-19f8ccfc3ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.590750 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af4253-da8c-497b-8199-19f8ccfc3ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.591071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af4253-da8c-497b-8199-19f8ccfc3ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.591925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af4253-da8c-497b-8199-19f8ccfc3ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.593624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af4253-da8c-497b-8199-19f8ccfc3ba9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.606621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1039/2058] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:58.607890 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af4253-da8c-497b-8199-19f8ccfc3ba9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.610041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-53af4253-da8c-497b-8199-19f8ccfc3ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.644069 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7acb1-6d8b-4518-b021-5b75624eac99 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.649232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900b9f5-4898-49bb-8422-651874ba7ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.650366 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b9f5-4898-49bb-8422-651874ba7ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.650820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b9f5-4898-49bb-8422-651874ba7ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.651306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900b9f5-4898-49bb-8422-651874ba7ce2 admin admin] PATH_INFO: `/v3/projects/863655445e6a4cbd9bc3f1ec241aff89/users/514e1d2d01b04813999205d71f3edb08/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.672029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900b9f5-4898-49bb-8422-651874ba7ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863655445e6a4cbd9bc3f1ec241aff89, user_id=514e1d2d01b04813999205d71f3edb08, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.676107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900b9f5-4898-49bb-8422-651874ba7ce2 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.696229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1020/2059] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:58 2022] PUT /identity/v3/projects/863655445e6a4cbd9bc3f1ec241aff89/users/514e1d2d01b04813999205d71f3edb08/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:58.696229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900b9f5-4898-49bb-8422-651874ba7ce2 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.696229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8900b9f5-4898-49bb-8422-651874ba7ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.706190 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af4253-da8c-497b-8199-19f8ccfc3ba9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.760081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4dac6-11ad-4dc1-9350-42b5fc451954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.761267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4dac6-11ad-4dc1-9350-42b5fc451954 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.761549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4dac6-11ad-4dc1-9350-42b5fc451954 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.761853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4dac6-11ad-4dc1-9350-42b5fc451954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.764100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8bf4dac6-11ad-4dc1-9350-42b5fc451954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.771169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900b9f5-4898-49bb-8422-651874ba7ce2 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.779337 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b4cc4-b299-4c64-aa67-c15e1b7e9b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.780392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b4cc4-b299-4c64-aa67-c15e1b7e9b5a admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.780865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b4cc4-b299-4c64-aa67-c15e1b7e9b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.781336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b4cc4-b299-4c64-aa67-c15e1b7e9b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.782503 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b4cc4-b299-4c64-aa67-c15e1b7e9b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.784418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b4cc4-b299-4c64-aa67-c15e1b7e9b5a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.798646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1021/2060] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:58.799959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b4cc4-b299-4c64-aa67-c15e1b7e9b5a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.802059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b49b4cc4-b299-4c64-aa67-c15e1b7e9b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.820733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b4cc4-b299-4c64-aa67-c15e1b7e9b5a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.830501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.831895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.832392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.832923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] PATH_INFO: `/v3/users/26e6dc69c4fb4ddaaf29c71b3d3a76df` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.834653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e6dc69c4fb4ddaaf29c71b3d3a76df)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.838453 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.893244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4dac6-11ad-4dc1-9350-42b5fc451954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.894930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4dac6-11ad-4dc1-9350-42b5fc451954 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.905497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e6dc69c4fb4ddaaf29c71b3d3a76df'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:58.906452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e6dc69c4fb4ddaaf29c71b3d3a76df'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:58.907080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e6dc69c4fb4ddaaf29c71b3d3a76df'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:58.907384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1040/2061] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:58.908701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4dac6-11ad-4dc1-9350-42b5fc451954 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.910748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8bf4dac6-11ad-4dc1-9350-42b5fc451954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.929395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e6dc69c4fb4ddaaf29c71b3d3a76df'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:58.940231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4dac6-11ad-4dc1-9350-42b5fc451954 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:58.942640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e6dc69c4fb4ddaaf29c71b3d3a76df'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:55:58.947743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa6078-0a3b-47b4-826f-f2bf92eb6fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:58.949299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa6078-0a3b-47b4-826f-f2bf92eb6fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:58.949721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa6078-0a3b-47b4-826f-f2bf92eb6fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:58.949918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa6078-0a3b-47b4-826f-f2bf92eb6fe2 admin admin] PATH_INFO: `/v3/projects/7b6a8c0b89384d04aaddb77a78efcacf/users/9474a53f94db4c66a18202a9b46c3279/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:58.952415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa6078-0a3b-47b4-826f-f2bf92eb6fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6a8c0b89384d04aaddb77a78efcacf, user_id=9474a53f94db4c66a18202a9b46c3279, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:58.956329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa6078-0a3b-47b4-826f-f2bf92eb6fe2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:58.960702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1022/2062] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:55:58 2022] DELETE /identity/v3/users/26e6dc69c4fb4ddaaf29c71b3d3a76df => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:58.960702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.962247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:58.976042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1041/2063] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:58 2022] PUT /identity/v3/projects/7b6a8c0b89384d04aaddb77a78efcacf/users/9474a53f94db4c66a18202a9b46c3279/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:58.976937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa6078-0a3b-47b4-826f-f2bf92eb6fe2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:58.978619 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f0aa6078-0a3b-47b4-826f-f2bf92eb6fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:59.056850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa6078-0a3b-47b4-826f-f2bf92eb6fe2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:59.065749 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24001ea-f0ba-44c5-801f-a621b05d3509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:59.066798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24001ea-f0ba-44c5-801f-a621b05d3509 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.067172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24001ea-f0ba-44c5-801f-a621b05d3509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.067577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24001ea-f0ba-44c5-801f-a621b05d3509 admin admin] PATH_INFO: `/v3/projects/32d8e09ab8fb4537b40df3a093dc7db6/users/452716804e7e4425bcc575bf1c6431f4/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.091419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff6fe9-c677-4b8b-a6cb-3936cf866f37 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:59.096985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24001ea-f0ba-44c5-801f-a621b05d3509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d8e09ab8fb4537b40df3a093dc7db6, user_id=452716804e7e4425bcc575bf1c6431f4, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:59.100093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e404b5-ed48-437d-91fb-0b057f37fe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:59.100951 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e404b5-ed48-437d-91fb-0b057f37fe42 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.103056 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24001ea-f0ba-44c5-801f-a621b05d3509 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:59.103517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e404b5-ed48-437d-91fb-0b057f37fe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.103949 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e404b5-ed48-437d-91fb-0b057f37fe42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.105249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e404b5-ed48-437d-91fb-0b057f37fe42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:59.110323 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e404b5-ed48-437d-91fb-0b057f37fe42 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:59.126126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1023/2064] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:55:59.127754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafe528-43b4-4e7e-9b99-813afd7d6221 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.128236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafe528-43b4-4e7e-9b99-813afd7d6221 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.128676 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafe528-43b4-4e7e-9b99-813afd7d6221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.145628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1042/2065] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:58 2022] PUT /identity/v3/projects/32d8e09ab8fb4537b40df3a093dc7db6/users/452716804e7e4425bcc575bf1c6431f4/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:59.145628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24001ea-f0ba-44c5-801f-a621b05d3509 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:59.178529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-fbafe528-43b4-4e7e-9b99-813afd7d6221 None None] MFA Rules not processed for user `9474a53f94db4c66a18202a9b46c3279`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:59.180642 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-fbafe528-43b4-4e7e-9b99-813afd7d6221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:59.321336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1024/2066] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:59.322853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ce3a-5878-4b2b-8c2d-746b328f4ec5 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.323754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ce3a-5878-4b2b-8c2d-746b328f4ec5 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.329809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3ce3a-5878-4b2b-8c2d-746b328f4ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.348776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24001ea-f0ba-44c5-801f-a621b05d3509 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:59.361710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ff8d-6f94-4e9e-a3bd-650e9401d1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:59.363039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ff8d-6f94-4e9e-a3bd-650e9401d1a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.363546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ff8d-6f94-4e9e-a3bd-650e9401d1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.364026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ff8d-6f94-4e9e-a3bd-650e9401d1a4 admin admin] PATH_INFO: `/v3/projects/863655445e6a4cbd9bc3f1ec241aff89/users/514e1d2d01b04813999205d71f3edb08/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.372187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425ff8d-6f94-4e9e-a3bd-650e9401d1a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863655445e6a4cbd9bc3f1ec241aff89, user_id=514e1d2d01b04813999205d71f3edb08, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:59.378166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425ff8d-6f94-4e9e-a3bd-650e9401d1a4 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:59.380584 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-56d3ce3a-5878-4b2b-8c2d-746b328f4ec5 None None] MFA Rules not processed for user `452716804e7e4425bcc575bf1c6431f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:59.381892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-56d3ce3a-5878-4b2b-8c2d-746b328f4ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:59.413652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1043/2067] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:55:59 2022] PUT /identity/v3/projects/863655445e6a4cbd9bc3f1ec241aff89/users/514e1d2d01b04813999205d71f3edb08/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:55:59.413652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32266a3-b47c-46be-a88e-54e0de54681c None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.413652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32266a3-b47c-46be-a88e-54e0de54681c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.413652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32266a3-b47c-46be-a88e-54e0de54681c None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.413652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1044/2068] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 12:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:55:59.413652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32266a3-b47c-46be-a88e-54e0de54681c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:59.428693 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d32266a3-b47c-46be-a88e-54e0de54681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:59.529496 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1025/2069] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:59.534994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b28f7-102b-40a6-b84d-bc05fa7659c7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.535307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b28f7-102b-40a6-b84d-bc05fa7659c7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.536210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b28f7-102b-40a6-b84d-bc05fa7659c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.572176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32266a3-b47c-46be-a88e-54e0de54681c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:59.572984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-351b28f7-102b-40a6-b84d-bc05fa7659c7 None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:59.576809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-351b28f7-102b-40a6-b84d-bc05fa7659c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:59.576986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467bc78-2627-446f-88a2-250d01053a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:59.577800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467bc78-2627-446f-88a2-250d01053a7f service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.578558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467bc78-2627-446f-88a2-250d01053a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.578558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467bc78-2627-446f-88a2-250d01053a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.668493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467bc78-2627-446f-88a2-250d01053a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:59.670289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467bc78-2627-446f-88a2-250d01053a7f service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:59.672290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1026/2070] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 12:55:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:59.673417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d1105-78df-48d6-9f7b-563a6504124d None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.673825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d1105-78df-48d6-9f7b-563a6504124d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.674206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d1105-78df-48d6-9f7b-563a6504124d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.681655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1045/2071] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:59.681869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467bc78-2627-446f-88a2-250d01053a7f service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:59.684021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6467bc78-2627-446f-88a2-250d01053a7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:59.706584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467bc78-2627-446f-88a2-250d01053a7f service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:59.711849 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611daf9-62d1-4cea-8925-e2af206fade4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:59.712731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611daf9-62d1-4cea-8925-e2af206fade4 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.713052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611daf9-62d1-4cea-8925-e2af206fade4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.713464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611daf9-62d1-4cea-8925-e2af206fade4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.725588 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-1e4d1105-78df-48d6-9f7b-563a6504124d None None] MFA Rules not processed for user `514e1d2d01b04813999205d71f3edb08`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:55:59.727038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1e4d1105-78df-48d6-9f7b-563a6504124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:59.806564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611daf9-62d1-4cea-8925-e2af206fade4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:59.811477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611daf9-62d1-4cea-8925-e2af206fade4 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:59.833722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1046/2072] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:59.836177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611daf9-62d1-4cea-8925-e2af206fade4 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:59.837760 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f611daf9-62d1-4cea-8925-e2af206fade4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:59.867284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1027/2073] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:55:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:55:59.868322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d1105-78df-48d6-9f7b-563a6504124d None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:59.870023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1e4d1105-78df-48d6-9f7b-563a6504124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:55:59.891180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d1105-78df-48d6-9f7b-563a6504124d None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:59.907201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db42d6-784f-4783-a45c-05758e01c2bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:59.908019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db42d6-784f-4783-a45c-05758e01c2bc service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.908425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db42d6-784f-4783-a45c-05758e01c2bc service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.908923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db42d6-784f-4783-a45c-05758e01c2bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.919605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db42d6-784f-4783-a45c-05758e01c2bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:59.921375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db42d6-784f-4783-a45c-05758e01c2bc service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:59.940121 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1028/2074] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:55:59.941089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db42d6-784f-4783-a45c-05758e01c2bc service nova] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:55:59.952704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db42d6-784f-4783-a45c-05758e01c2bc service nova] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:59.961957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dce72-5c9f-42e7-86fa-39218a1731cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:59.962625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dce72-5c9f-42e7-86fa-39218a1731cb service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.962911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dce72-5c9f-42e7-86fa-39218a1731cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.964841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dce72-5c9f-42e7-86fa-39218a1731cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.983265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611daf9-62d1-4cea-8925-e2af206fade4 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:55:59.991009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dce72-5c9f-42e7-86fa-39218a1731cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:59.991212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:55:59.992042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:55:59.992393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:55:59.992528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42dce72-5c9f-42e7-86fa-39218a1731cb service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:55:59.992793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] PATH_INFO: `/v3/projects/f248b6ef49a54eb7bcceb0e200764722` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:55:59.994628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f248b6ef49a54eb7bcceb0e200764722)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:55:59.998422 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:00.004715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1029/2075] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:55:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:00.075130 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f248b6ef49a54eb7bcceb0e200764722', 'request_id': 'req-46738e42-1791-4b19-b834-5e6094c47302'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:00.083663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dce72-5c9f-42e7-86fa-39218a1731cb service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:00.085303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d42dce72-5c9f-42e7-86fa-39218a1731cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:00.087597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f248b6ef49a54eb7bcceb0e200764722', 'request_id': 'req-46738e42-1791-4b19-b834-5e6094c47302'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:00.098936 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f248b6ef49a54eb7bcceb0e200764722', 'request_id': 'req-46738e42-1791-4b19-b834-5e6094c47302'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:00.102060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dce72-5c9f-42e7-86fa-39218a1731cb service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:00.114878 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] The token cache is being invalidate because project f248b6ef49a54eb7bcceb0e200764722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:00.115243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:00.116069 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:00.122512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1047/2076] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:55:59 2022] DELETE /identity/v3/projects/f248b6ef49a54eb7bcceb0e200764722 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:00.123817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:00.125508 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:00.185618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:00.186864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:00.187152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:00.187437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] PATH_INFO: `/v3/users/b67a6fdf95374642a81d4c9d143c8dd1` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:00.189671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67a6fdf95374642a81d4c9d143c8dd1)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:00.191737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:00.212314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46738e42-1791-4b19-b834-5e6094c47302 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:00.218790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9737bcf-2c19-46b7-a2aa-9091b3553e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:00.219964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9737bcf-2c19-46b7-a2aa-9091b3553e79 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:00.219964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9737bcf-2c19-46b7-a2aa-9091b3553e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:00.220393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9737bcf-2c19-46b7-a2aa-9091b3553e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:00.222934 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a9737bcf-2c19-46b7-a2aa-9091b3553e79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:00.262091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67a6fdf95374642a81d4c9d143c8dd1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:00.263705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67a6fdf95374642a81d4c9d143c8dd1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:00.264532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67a6fdf95374642a81d4c9d143c8dd1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:00.273278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67a6fdf95374642a81d4c9d143c8dd1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:00.288738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b9c52d23-3e7f-459b-8cf0-21cdde1b0578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67a6fdf95374642a81d4c9d143c8dd1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:00.317590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1030/2077] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:00 2022] DELETE /identity/v3/users/b67a6fdf95374642a81d4c9d143c8dd1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:00.320739 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7254c-94b1-49c4-8259-8b72d8ea5963 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:00.321171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7254c-94b1-49c4-8259-8b72d8ea5963 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:00.321737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7254c-94b1-49c4-8259-8b72d8ea5963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:00.344955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9737bcf-2c19-46b7-a2aa-9091b3553e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:00.348824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9737bcf-2c19-46b7-a2aa-9091b3553e79 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:00.349437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-02f7254c-94b1-49c4-8259-8b72d8ea5963 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:00.351162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-02f7254c-94b1-49c4-8259-8b72d8ea5963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:00.373539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1048/2078] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:00.374804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5012895-345e-4fae-9e0a-caffffb4aa57 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:00.375096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5012895-345e-4fae-9e0a-caffffb4aa57 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:00.377656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5012895-345e-4fae-9e0a-caffffb4aa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:00.421001 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-a5012895-345e-4fae-9e0a-caffffb4aa57 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:00.424251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a5012895-345e-4fae-9e0a-caffffb4aa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:00.490318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1031/2079] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:00.504431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c41f93-1bb5-467f-86f8-69437a3f87ff None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:00.504775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c41f93-1bb5-467f-86f8-69437a3f87ff None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:00.505058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c41f93-1bb5-467f-86f8-69437a3f87ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:00.560892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-26c41f93-1bb5-467f-86f8-69437a3f87ff None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:00.562396 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-26c41f93-1bb5-467f-86f8-69437a3f87ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:00.585312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1032/2080] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:00.589135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c41f93-1bb5-467f-86f8-69437a3f87ff None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:00.603925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1049/2081] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:00.604880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c41f93-1bb5-467f-86f8-69437a3f87ff None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:00.607414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5012895-345e-4fae-9e0a-caffffb4aa57 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:00.610015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8391b-e890-4dd4-b2fd-d68f169e7ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:00.610605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8391b-e890-4dd4-b2fd-d68f169e7ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:00.610891 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8391b-e890-4dd4-b2fd-d68f169e7ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:00.611156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8391b-e890-4dd4-b2fd-d68f169e7ca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:00.611896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8391b-e890-4dd4-b2fd-d68f169e7ca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:00.612274 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8391b-e890-4dd4-b2fd-d68f169e7ca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:00.613223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a5012895-345e-4fae-9e0a-caffffb4aa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:00.614038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8391b-e890-4dd4-b2fd-d68f169e7ca2 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:00.638728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1033/2082] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:56:00.644030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8391b-e890-4dd4-b2fd-d68f169e7ca2 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:00.660955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8391b-e890-4dd4-b2fd-d68f169e7ca2 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:00.677700 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829019a-1cdf-4c01-9e14-8f7bea7d3dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:00.678527 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829019a-1cdf-4c01-9e14-8f7bea7d3dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:00.678946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829019a-1cdf-4c01-9e14-8f7bea7d3dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:00.679951 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829019a-1cdf-4c01-9e14-8f7bea7d3dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:00.680200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829019a-1cdf-4c01-9e14-8f7bea7d3dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:00.683562 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829019a-1cdf-4c01-9e14-8f7bea7d3dc4 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:00.743382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1034/2083] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:00 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:00.744693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829019a-1cdf-4c01-9e14-8f7bea7d3dc4 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:00.768126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5012895-345e-4fae-9e0a-caffffb4aa57 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:00.882795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829019a-1cdf-4c01-9e14-8f7bea7d3dc4 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:00.899726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c764d97-167f-41f9-ad28-376c64d23f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:00.907012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764d97-167f-41f9-ad28-376c64d23f24 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:00.907344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764d97-167f-41f9-ad28-376c64d23f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:00.907591 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c764d97-167f-41f9-ad28-376c64d23f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:00.908258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fd3c6-d484-4ea5-849b-c7b7247deed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:00.909681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fd3c6-d484-4ea5-849b-c7b7247deed7 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:00.912393 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fd3c6-d484-4ea5-849b-c7b7247deed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:00.912703 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fd3c6-d484-4ea5-849b-c7b7247deed7 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:00.913459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fd3c6-d484-4ea5-849b-c7b7247deed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:00.929109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fd3c6-d484-4ea5-849b-c7b7247deed7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:00.951398 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c764d97-167f-41f9-ad28-376c64d23f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:00.952927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c764d97-167f-41f9-ad28-376c64d23f24 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:00.984145 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1050/2084] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:01.007302 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1035/2085] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:00 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:01.009182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c764d97-167f-41f9-ad28-376c64d23f24 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:01.021995 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c764d97-167f-41f9-ad28-376c64d23f24 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:01.047481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41656b-6426-4e68-9a73-c277a9375ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:01.048203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41656b-6426-4e68-9a73-c277a9375ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:01.048492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41656b-6426-4e68-9a73-c277a9375ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:01.048765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41656b-6426-4e68-9a73-c277a9375ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:01.049502 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41656b-6426-4e68-9a73-c277a9375ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:01.051149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41656b-6426-4e68-9a73-c277a9375ea8 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:01.078559 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fd3c6-d484-4ea5-849b-c7b7247deed7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:01.086786 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1051/2086] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:01.111094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fd3c6-d484-4ea5-849b-c7b7247deed7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:01.129666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac957dd2-0072-4be5-8c6a-9487401ec5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:01.131393 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac957dd2-0072-4be5-8c6a-9487401ec5cf admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:01.131893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac957dd2-0072-4be5-8c6a-9487401ec5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:01.132364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac957dd2-0072-4be5-8c6a-9487401ec5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:01.133353 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac957dd2-0072-4be5-8c6a-9487401ec5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:01.138209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac957dd2-0072-4be5-8c6a-9487401ec5cf admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:01.161350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1036/2087] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:01.165556 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41656b-6426-4e68-9a73-c277a9375ea8 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:01.188242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41656b-6426-4e68-9a73-c277a9375ea8 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:01.195665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff4b49-f4da-4b5e-b861-30ad41f03f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:01.197601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4b49-f4da-4b5e-b861-30ad41f03f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:01.197729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4b49-f4da-4b5e-b861-30ad41f03f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:01.198391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4b49-f4da-4b5e-b861-30ad41f03f31 admin admin] PATH_INFO: `/v3/projects/f3ee67d01e834e6ea2672e8bf9656d5f/users/79e13f6a42a64bfb90b869d7375955b4/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:01.228743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff4b49-f4da-4b5e-b861-30ad41f03f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ee67d01e834e6ea2672e8bf9656d5f, user_id=79e13f6a42a64bfb90b869d7375955b4, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:01.233197 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff4b49-f4da-4b5e-b861-30ad41f03f31 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:01.255871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1052/2088] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:01 2022] PUT /identity/v3/projects/f3ee67d01e834e6ea2672e8bf9656d5f/users/79e13f6a42a64bfb90b869d7375955b4/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:01.268981 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeeb425-17ab-47f9-ae09-b3a6b748e57d None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:01.269281 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeeb425-17ab-47f9-ae09-b3a6b748e57d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:01.269565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeeb425-17ab-47f9-ae09-b3a6b748e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:01.320352 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-cfeeb425-17ab-47f9-ae09-b3a6b748e57d None None] MFA Rules not processed for user `79e13f6a42a64bfb90b869d7375955b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:01.321823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-cfeeb425-17ab-47f9-ae09-b3a6b748e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:01.482781 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1037/2089] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:01.499045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff4b49-f4da-4b5e-b861-30ad41f03f31 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:01.500850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b3ff4b49-f4da-4b5e-b861-30ad41f03f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:01.629893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff4b49-f4da-4b5e-b861-30ad41f03f31 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:01.636969 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db047d89-e0ac-4c49-bb6d-11ef6764370a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:01.638378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db047d89-e0ac-4c49-bb6d-11ef6764370a service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:01.638776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db047d89-e0ac-4c49-bb6d-11ef6764370a service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:01.639660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db047d89-e0ac-4c49-bb6d-11ef6764370a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:01.653672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db047d89-e0ac-4c49-bb6d-11ef6764370a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:01.656054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db047d89-e0ac-4c49-bb6d-11ef6764370a service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:01.667794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1053/2090] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:01.693501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeeb425-17ab-47f9-ae09-b3a6b748e57d None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:01.807143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeeb425-17ab-47f9-ae09-b3a6b748e57d None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:01.816458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:01.817645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:01.818686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:01.819001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] PATH_INFO: `/v3/users/79e13f6a42a64bfb90b869d7375955b4` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:01.820469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79e13f6a42a64bfb90b869d7375955b4)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:01.822621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:01.883029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db047d89-e0ac-4c49-bb6d-11ef6764370a service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:01.886222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-db047d89-e0ac-4c49-bb6d-11ef6764370a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:01.890856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79e13f6a42a64bfb90b869d7375955b4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:01.891597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79e13f6a42a64bfb90b869d7375955b4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:01.892219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79e13f6a42a64bfb90b869d7375955b4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:01.900895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79e13f6a42a64bfb90b869d7375955b4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:01.914493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db047d89-e0ac-4c49-bb6d-11ef6764370a service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:01.921071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9d48ef08-a832-4c2e-a24d-332a137ba751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79e13f6a42a64bfb90b869d7375955b4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:01.932273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:01.935047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:01.936239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:01.936639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] PATH_INFO: `/v3/projects/fbed4de3b3bd49f4ac53c84d1d4d75ee` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:01.938102 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbed4de3b3bd49f4ac53c84d1d4d75ee)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:01.940325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1038/2091] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:01 2022] DELETE /identity/v3/users/79e13f6a42a64bfb90b869d7375955b4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:01.940480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:01.944639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c9233-7718-4fc1-8b48-c2906e1ffb18 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:01.945158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c9233-7718-4fc1-8b48-c2906e1ffb18 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:01.945446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c9233-7718-4fc1-8b48-c2906e1ffb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:01.970207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-085c9233-7718-4fc1-8b48-c2906e1ffb18 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:01.971457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-085c9233-7718-4fc1-8b48-c2906e1ffb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:02.065873 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbed4de3b3bd49f4ac53c84d1d4d75ee', 'request_id': 'req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.088294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbed4de3b3bd49f4ac53c84d1d4d75ee', 'request_id': 'req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.112120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbed4de3b3bd49f4ac53c84d1d4d75ee', 'request_id': 'req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.141480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] The token cache is being invalidate because project fbed4de3b3bd49f4ac53c84d1d4d75ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:02.141867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.142555 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.150445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1054/2092] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:01 2022] DELETE /identity/v3/projects/fbed4de3b3bd49f4ac53c84d1d4d75ee => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:02.152411 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:02.153194 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:02.188470 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1039/2093] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:02.206911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c9233-7718-4fc1-8b48-c2906e1ffb18 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:02.207825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-085c9233-7718-4fc1-8b48-c2906e1ffb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:02.283643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b1d1e-e60d-4cc3-a007-4610a2ef584e admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:02.314580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:02.318521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:02.319646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:02.319950 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] PATH_INFO: `/v3/users/9474a53f94db4c66a18202a9b46c3279` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:02.331086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9474a53f94db4c66a18202a9b46c3279)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:02.335001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c9233-7718-4fc1-8b48-c2906e1ffb18 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:02.339128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:02.461721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9474a53f94db4c66a18202a9b46c3279'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.465750 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9474a53f94db4c66a18202a9b46c3279'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.466889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9474a53f94db4c66a18202a9b46c3279'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.487828 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ffe9a-77ec-4ae1-b638-920daa45b47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:02.489261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ffe9a-77ec-4ae1-b638-920daa45b47a service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:02.489548 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ffe9a-77ec-4ae1-b638-920daa45b47a service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:02.489853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ffe9a-77ec-4ae1-b638-920daa45b47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:02.496696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a98ffe9a-77ec-4ae1-b638-920daa45b47a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:02.500649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9474a53f94db4c66a18202a9b46c3279'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.515741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9474a53f94db4c66a18202a9b46c3279'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.520881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ffe9a-77ec-4ae1-b638-920daa45b47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:02.522402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ffe9a-77ec-4ae1-b638-920daa45b47a service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:02.539870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1055/2094] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:02 2022] DELETE /identity/v3/users/9474a53f94db4c66a18202a9b46c3279 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:02.542718 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1040/2095] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:02.581875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:02.584189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:02.699319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904212f-dc6c-497d-9876-cbb10ec9fe99 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:02.707778 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:02.709025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:02.709543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:02.710115 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] PATH_INFO: `/v3/users/f81b75defdfd4a3d8a130cfe03ae5a17` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:02.712069 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81b75defdfd4a3d8a130cfe03ae5a17)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:02.715794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:02.828163 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81b75defdfd4a3d8a130cfe03ae5a17'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.829296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81b75defdfd4a3d8a130cfe03ae5a17'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.830156 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81b75defdfd4a3d8a130cfe03ae5a17'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.847234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81b75defdfd4a3d8a130cfe03ae5a17'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.856870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81b75defdfd4a3d8a130cfe03ae5a17'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:02.893647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1056/2096] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:02 2022] DELETE /identity/v3/users/f81b75defdfd4a3d8a130cfe03ae5a17 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:02.899437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ce49-b9c4-434e-8e06-f257466efd3a None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:02.900257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ce49-b9c4-434e-8e06-f257466efd3a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:02.900899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827ce49-b9c4-434e-8e06-f257466efd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:02.926197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b827ce49-b9c4-434e-8e06-f257466efd3a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:02.927623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b827ce49-b9c4-434e-8e06-f257466efd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:02.961010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:02.962543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:02.997498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1041/2097] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:03.009747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827ce49-b9c4-434e-8e06-f257466efd3a None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.011491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b827ce49-b9c4-434e-8e06-f257466efd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.062347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36471106-17c8-46f8-9626-d625b5860758 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.067274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.068206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.068546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.068887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] PATH_INFO: `/v3/projects/7b6a8c0b89384d04aaddb77a78efcacf` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.070155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6a8c0b89384d04aaddb77a78efcacf)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.072193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.075103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827ce49-b9c4-434e-8e06-f257466efd3a None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.080290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ed7f-8d06-41a6-bbd7-8bbd2dc1417d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.081032 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ed7f-8d06-41a6-bbd7-8bbd2dc1417d service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.081376 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ed7f-8d06-41a6-bbd7-8bbd2dc1417d service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.081745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ed7f-8d06-41a6-bbd7-8bbd2dc1417d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.092410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84ed7f-8d06-41a6-bbd7-8bbd2dc1417d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.094198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84ed7f-8d06-41a6-bbd7-8bbd2dc1417d service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.104985 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1042/2098] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:03.105941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ed7f-8d06-41a6-bbd7-8bbd2dc1417d service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.107360 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bf84ed7f-8d06-41a6-bbd7-8bbd2dc1417d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.128108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ed7f-8d06-41a6-bbd7-8bbd2dc1417d service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.139218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6a8c0b89384d04aaddb77a78efcacf', 'request_id': 'req-3f95e59b-39ed-4682-b671-7514050e1781'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.142418 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6a8c0b89384d04aaddb77a78efcacf', 'request_id': 'req-3f95e59b-39ed-4682-b671-7514050e1781'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.153034 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6a8c0b89384d04aaddb77a78efcacf', 'request_id': 'req-3f95e59b-39ed-4682-b671-7514050e1781'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.170061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] The token cache is being invalidate because project 7b6a8c0b89384d04aaddb77a78efcacf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:03.170665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.171393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3f95e59b-39ed-4682-b671-7514050e1781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.173187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1057/2099] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:02 2022] DELETE /identity/v3/projects/7b6a8c0b89384d04aaddb77a78efcacf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:03.178202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfc167-e987-46da-8b69-d2b1e1e0ed91 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.178492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfc167-e987-46da-8b69-d2b1e1e0ed91 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.178769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfc167-e987-46da-8b69-d2b1e1e0ed91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.204240 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-37cfc167-e987-46da-8b69-d2b1e1e0ed91 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:03.205523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-37cfc167-e987-46da-8b69-d2b1e1e0ed91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.228736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.230299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.230649 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.230987 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] PATH_INFO: `/v3/projects/f3ee67d01e834e6ea2672e8bf9656d5f` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.232301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ee67d01e834e6ea2672e8bf9656d5f)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.235342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.270871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1058/2100] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:03.280016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910972-4b13-411b-92f3-ccbb4abe66cc None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.283240 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910972-4b13-411b-92f3-ccbb4abe66cc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.283240 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e910972-4b13-411b-92f3-ccbb4abe66cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.307325 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-8e910972-4b13-411b-92f3-ccbb4abe66cc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:03.308569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8e910972-4b13-411b-92f3-ccbb4abe66cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.336066 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ee67d01e834e6ea2672e8bf9656d5f', 'request_id': 'req-0ede11a7-e54f-4f15-850a-bc2e3b1826da'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.346290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ee67d01e834e6ea2672e8bf9656d5f', 'request_id': 'req-0ede11a7-e54f-4f15-850a-bc2e3b1826da'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.357066 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ee67d01e834e6ea2672e8bf9656d5f', 'request_id': 'req-0ede11a7-e54f-4f15-850a-bc2e3b1826da'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.376606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] The token cache is being invalidate because project f3ee67d01e834e6ea2672e8bf9656d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:03.376901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.377607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0ede11a7-e54f-4f15-850a-bc2e3b1826da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.379220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1043/2101] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:03 2022] DELETE /identity/v3/projects/f3ee67d01e834e6ea2672e8bf9656d5f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:03.384070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcea91-5921-432b-84ea-d2d3934dce50 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.384344 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcea91-5921-432b-84ea-d2d3934dce50 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.384626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bcea91-5921-432b-84ea-d2d3934dce50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.392832 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1059/2102] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:03.397874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910972-4b13-411b-92f3-ccbb4abe66cc None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.408963 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e910972-4b13-411b-92f3-ccbb4abe66cc None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.410688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b8bcea91-5921-432b-84ea-d2d3934dce50 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:03.413853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924339c-1a23-47bc-82f0-299b5f537b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.414061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b8bcea91-5921-432b-84ea-d2d3934dce50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.414908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924339c-1a23-47bc-82f0-299b5f537b13 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.414908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924339c-1a23-47bc-82f0-299b5f537b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.415104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924339c-1a23-47bc-82f0-299b5f537b13 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.415859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924339c-1a23-47bc-82f0-299b5f537b13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:03.416171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924339c-1a23-47bc-82f0-299b5f537b13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.418667 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924339c-1a23-47bc-82f0-299b5f537b13 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.429107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1044/2103] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:03.437915 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ef93a-be45-4577-b643-567c40b368d0 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.438328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ef93a-be45-4577-b643-567c40b368d0 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.439777 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ef93a-be45-4577-b643-567c40b368d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.439913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1060/2104] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:03.446127 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924339c-1a23-47bc-82f0-299b5f537b13 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.460674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c83ef93a-be45-4577-b643-567c40b368d0 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:03.462136 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c83ef93a-be45-4577-b643-567c40b368d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.475996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1045/2105] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:03.477245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ef93a-be45-4577-b643-567c40b368d0 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.478603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924339c-1a23-47bc-82f0-299b5f537b13 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.481841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c83ef93a-be45-4577-b643-567c40b368d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.489297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fac55b-d383-47a7-918e-6f6099233fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.490297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fac55b-d383-47a7-918e-6f6099233fca admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.490579 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fac55b-d383-47a7-918e-6f6099233fca admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.490849 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fac55b-d383-47a7-918e-6f6099233fca admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.491549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fac55b-d383-47a7-918e-6f6099233fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.494362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fac55b-d383-47a7-918e-6f6099233fca admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.503441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ef93a-be45-4577-b643-567c40b368d0 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.509400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.511112 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.511697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.511977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] PATH_INFO: `/v3/projects/32bcf4e51e844a53ad928d54e197f321` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.513516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bcf4e51e844a53ad928d54e197f321)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.515852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.531754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1061/2106] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:03 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:56:03.531754 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fac55b-d383-47a7-918e-6f6099233fca admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.580719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bcf4e51e844a53ad928d54e197f321', 'request_id': 'req-ed8038b5-2855-4a14-95ce-5f466c30758a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.588919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bcf4e51e844a53ad928d54e197f321', 'request_id': 'req-ed8038b5-2855-4a14-95ce-5f466c30758a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.599227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bcf4e51e844a53ad928d54e197f321', 'request_id': 'req-ed8038b5-2855-4a14-95ce-5f466c30758a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.605220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fac55b-d383-47a7-918e-6f6099233fca admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.612158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] The token cache is being invalidate because project 32bcf4e51e844a53ad928d54e197f321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:03.612511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.613273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.615019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1046/2107] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:03 2022] DELETE /identity/v3/projects/32bcf4e51e844a53ad928d54e197f321 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:03.615839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.617358 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.686017 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3a460-c37a-4ed2-807d-e98c513c5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.687820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8038b5-2855-4a14-95ce-5f466c30758a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.688929 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3a460-c37a-4ed2-807d-e98c513c5fba admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.689691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3a460-c37a-4ed2-807d-e98c513c5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.690143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3a460-c37a-4ed2-807d-e98c513c5fba admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.691357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3a460-c37a-4ed2-807d-e98c513c5fba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:03.691357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3a460-c37a-4ed2-807d-e98c513c5fba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.693004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3a460-c37a-4ed2-807d-e98c513c5fba admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.693117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f77bc-b18d-4870-8925-a5ef7a905393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.693934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f77bc-b18d-4870-8925-a5ef7a905393 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.694109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f77bc-b18d-4870-8925-a5ef7a905393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.694355 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f77bc-b18d-4870-8925-a5ef7a905393 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.695054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f77bc-b18d-4870-8925-a5ef7a905393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.697007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f77bc-b18d-4870-8925-a5ef7a905393 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.706329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1062/2108] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:03.707328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3a460-c37a-4ed2-807d-e98c513c5fba admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.709179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4dd3a460-c37a-4ed2-807d-e98c513c5fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.723122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3a460-c37a-4ed2-807d-e98c513c5fba admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.723528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1047/2109] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:03 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:03.724355 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f77bc-b18d-4870-8925-a5ef7a905393 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.726034 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-140f77bc-b18d-4870-8925-a5ef7a905393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.731142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.732027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.732315 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.732594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] PATH_INFO: `/v3/users/4e0bf0bfb13a446fa90cff484365abb4` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.733845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0bf0bfb13a446fa90cff484365abb4)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.735777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.738374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f77bc-b18d-4870-8925-a5ef7a905393 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.743407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca26e3-a3f4-4126-9a1c-9e6e52a0dbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.744069 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca26e3-a3f4-4126-9a1c-9e6e52a0dbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.744354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca26e3-a3f4-4126-9a1c-9e6e52a0dbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.744628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca26e3-a3f4-4126-9a1c-9e6e52a0dbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.745940 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca26e3-a3f4-4126-9a1c-9e6e52a0dbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.747889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca26e3-a3f4-4126-9a1c-9e6e52a0dbc4 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.776329 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1048/2110] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:03 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:03.777417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca26e3-a3f4-4126-9a1c-9e6e52a0dbc4 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.796137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0bf0bfb13a446fa90cff484365abb4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.796983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0bf0bfb13a446fa90cff484365abb4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.797663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0bf0bfb13a446fa90cff484365abb4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.812378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0bf0bfb13a446fa90cff484365abb4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.825079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0bf0bfb13a446fa90cff484365abb4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:03.839511 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1063/2111] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:03 2022] DELETE /identity/v3/users/4e0bf0bfb13a446fa90cff484365abb4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:03.840639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.842276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.854037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca26e3-a3f4-4126-9a1c-9e6e52a0dbc4 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.944952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bed39-9f49-47ba-bc96-2510701d8480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.945732 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bed39-9f49-47ba-bc96-2510701d8480 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.946018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bed39-9f49-47ba-bc96-2510701d8480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.946504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bed39-9f49-47ba-bc96-2510701d8480 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.947398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bed39-9f49-47ba-bc96-2510701d8480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.950145 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63bed39-9f49-47ba-bc96-2510701d8480 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.962422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1049/2112] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:03.967151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bed39-9f49-47ba-bc96-2510701d8480 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:03.967686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263244e8-90fc-47b4-8f74-1813fd78ec9e admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:03.972730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f63bed39-9f49-47ba-bc96-2510701d8480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:03.985038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95774b7-0760-47db-8fb6-765813455cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:03.985038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95774b7-0760-47db-8fb6-765813455cda admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:03.985038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95774b7-0760-47db-8fb6-765813455cda admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:03.985038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95774b7-0760-47db-8fb6-765813455cda admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:03.985356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95774b7-0760-47db-8fb6-765813455cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:03.995006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95774b7-0760-47db-8fb6-765813455cda admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:03.999423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bed39-9f49-47ba-bc96-2510701d8480 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.024015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d1181-468d-428a-9afa-f14038c3f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.024723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d1181-468d-428a-9afa-f14038c3f069 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.025333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d1181-468d-428a-9afa-f14038c3f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.025333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d1181-468d-428a-9afa-f14038c3f069 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.026159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d1181-468d-428a-9afa-f14038c3f069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.031602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d1181-468d-428a-9afa-f14038c3f069 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.043340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1064/2113] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:03 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:04.047650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1050/2114] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:04.047819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95774b7-0760-47db-8fb6-765813455cda admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:04.050060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d1181-468d-428a-9afa-f14038c3f069 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:04.064873 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95774b7-0760-47db-8fb6-765813455cda admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.070558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cfddc-878a-47af-ae4e-bef2cb1eecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.074364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d1181-468d-428a-9afa-f14038c3f069 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.076109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cfddc-878a-47af-ae4e-bef2cb1eecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.076412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cfddc-878a-47af-ae4e-bef2cb1eecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.076719 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429cfddc-878a-47af-ae4e-bef2cb1eecb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.078198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cfddc-878a-47af-ae4e-bef2cb1eecb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.083116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca58b1-4826-410d-b4df-bbb3e9b64ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.083547 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429cfddc-878a-47af-ae4e-bef2cb1eecb9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.084231 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca58b1-4826-410d-b4df-bbb3e9b64ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.084606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca58b1-4826-410d-b4df-bbb3e9b64ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.084953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca58b1-4826-410d-b4df-bbb3e9b64ee7 admin admin] PATH_INFO: `/v3/projects/26b233b125434f1a942f9602bdc2a4e5/users/05c92531c5cd4593b81d3e7270a655be/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.101620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1065/2115] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:56:04.106176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cfddc-878a-47af-ae4e-bef2cb1eecb9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:04.118923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429cfddc-878a-47af-ae4e-bef2cb1eecb9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.126083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fbc82-a69f-4804-9dc7-e9c0ad43ccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.127171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fbc82-a69f-4804-9dc7-e9c0ad43ccf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.127719 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fbc82-a69f-4804-9dc7-e9c0ad43ccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.128494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fbc82-a69f-4804-9dc7-e9c0ad43ccf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.128607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca58b1-4826-410d-b4df-bbb3e9b64ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b233b125434f1a942f9602bdc2a4e5, user_id=05c92531c5cd4593b81d3e7270a655be, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.129777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fbc82-a69f-4804-9dc7-e9c0ad43ccf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.131627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fbc82-a69f-4804-9dc7-e9c0ad43ccf5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.132119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca58b1-4826-410d-b4df-bbb3e9b64ee7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.145290 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1066/2116] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:56:04.148883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1051/2117] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:04 2022] PUT /identity/v3/projects/26b233b125434f1a942f9602bdc2a4e5/users/05c92531c5cd4593b81d3e7270a655be/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:04.149927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fbc82-a69f-4804-9dc7-e9c0ad43ccf5 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:04.159393 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8304a1e-4024-4fce-8d05-9370e6f72134 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.159679 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8304a1e-4024-4fce-8d05-9370e6f72134 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.159959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8304a1e-4024-4fce-8d05-9370e6f72134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.161694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fbc82-a69f-4804-9dc7-e9c0ad43ccf5 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.203001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d8304a1e-4024-4fce-8d05-9370e6f72134 None None] MFA Rules not processed for user `05c92531c5cd4593b81d3e7270a655be`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:04.205001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d8304a1e-4024-4fce-8d05-9370e6f72134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:04.245229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2869-498d-49c1-9745-187b92e97aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.246658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2869-498d-49c1-9745-187b92e97aed admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.250054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2869-498d-49c1-9745-187b92e97aed admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.250607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2869-498d-49c1-9745-187b92e97aed admin admin] PATH_INFO: `/v3/projects/4fabb27e899f4559b641000451899d2b/users/6b7fb550d29d4198b8337426cd108cdd/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.297092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a2869-498d-49c1-9745-187b92e97aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fabb27e899f4559b641000451899d2b, user_id=6b7fb550d29d4198b8337426cd108cdd, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.300016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a2869-498d-49c1-9745-187b92e97aed admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.322433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1067/2118] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:04 2022] PUT /identity/v3/projects/4fabb27e899f4559b641000451899d2b/users/6b7fb550d29d4198b8337426cd108cdd/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:04.330702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1052/2119] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:04.336388 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2869-498d-49c1-9745-187b92e97aed admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:04.340476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087ef54-d861-43ee-8fdc-c5de8dc272be None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.340716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087ef54-d861-43ee-8fdc-c5de8dc272be None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.341934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087ef54-d861-43ee-8fdc-c5de8dc272be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.392448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-6087ef54-d861-43ee-8fdc-c5de8dc272be None None] MFA Rules not processed for user `6b7fb550d29d4198b8337426cd108cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:04.394135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6087ef54-d861-43ee-8fdc-c5de8dc272be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:04.480538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2869-498d-49c1-9745-187b92e97aed admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.486454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be785d1-750e-43e9-b554-29fc03ace2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.487134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be785d1-750e-43e9-b554-29fc03ace2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.487442 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be785d1-750e-43e9-b554-29fc03ace2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.487715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be785d1-750e-43e9-b554-29fc03ace2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.488414 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be785d1-750e-43e9-b554-29fc03ace2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.490385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be785d1-750e-43e9-b554-29fc03ace2e9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.517170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1053/2120] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:04.518341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087ef54-d861-43ee-8fdc-c5de8dc272be None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:04.519985 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6087ef54-d861-43ee-8fdc-c5de8dc272be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:04.531118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1068/2121] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:04 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:04.532047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be785d1-750e-43e9-b554-29fc03ace2e9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:04.534091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5be785d1-750e-43e9-b554-29fc03ace2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:04.543213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087ef54-d861-43ee-8fdc-c5de8dc272be None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.603500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be785d1-750e-43e9-b554-29fc03ace2e9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.607942 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eb80b-c42d-40c3-b661-f1ed34bc6599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.608682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eb80b-c42d-40c3-b661-f1ed34bc6599 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.609058 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eb80b-c42d-40c3-b661-f1ed34bc6599 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.609424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eb80b-c42d-40c3-b661-f1ed34bc6599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.611628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.613330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.613330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.613330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] PATH_INFO: `/v3/projects/640fd8b48fff4bfb87c089b9864e4c98` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.614423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=640fd8b48fff4bfb87c089b9864e4c98)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.617493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.679101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eb80b-c42d-40c3-b661-f1ed34bc6599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.679441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '640fd8b48fff4bfb87c089b9864e4c98', 'request_id': 'req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.680625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eb80b-c42d-40c3-b661-f1ed34bc6599 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.688826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '640fd8b48fff4bfb87c089b9864e4c98', 'request_id': 'req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.692768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1069/2122] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:04.693821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eb80b-c42d-40c3-b661-f1ed34bc6599 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:04.701902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '640fd8b48fff4bfb87c089b9864e4c98', 'request_id': 'req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.708673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eb80b-c42d-40c3-b661-f1ed34bc6599 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.721950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] The token cache is being invalidate because project 640fd8b48fff4bfb87c089b9864e4c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:04.721950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.721950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.723228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1054/2123] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:04 2022] DELETE /identity/v3/projects/640fd8b48fff4bfb87c089b9864e4c98 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:04.724049 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:04.731346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:04.807010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ea22c-ef83-4990-86e0-b286588bad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.808468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ea22c-ef83-4990-86e0-b286588bad8e admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.808850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ea22c-ef83-4990-86e0-b286588bad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.809222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ea22c-ef83-4990-86e0-b286588bad8e admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.810310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ea22c-ef83-4990-86e0-b286588bad8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.813307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ea22c-ef83-4990-86e0-b286588bad8e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.833731 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ecab8-cfe0-4ff1-8f05-157e01bc2a53 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.840679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1070/2124] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:04 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:04.841822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.841962 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ea22c-ef83-4990-86e0-b286588bad8e admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:04.850585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.850879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.851145 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-777ea22c-ef83-4990-86e0-b286588bad8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:04.851260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] PATH_INFO: `/v3/users/aa27daf998904db784dd2110f8274285` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.852908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa27daf998904db784dd2110f8274285)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.855303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.870679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ea22c-ef83-4990-86e0-b286588bad8e admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:04.875970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:04.877425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:04.877802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:04.878498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] PATH_INFO: `/v3/users/6b7fb550d29d4198b8337426cd108cdd` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:04.880129 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7fb550d29d4198b8337426cd108cdd)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:04.882744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:04.945536 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa27daf998904db784dd2110f8274285'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.946522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa27daf998904db784dd2110f8274285'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.948694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa27daf998904db784dd2110f8274285'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.956946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7fb550d29d4198b8337426cd108cdd'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.957741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7fb550d29d4198b8337426cd108cdd'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.958323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7fb550d29d4198b8337426cd108cdd'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.960591 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa27daf998904db784dd2110f8274285'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.973886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7fb550d29d4198b8337426cd108cdd'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.978435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa27daf998904db784dd2110f8274285'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.983885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7fb550d29d4198b8337426cd108cdd'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:04.998446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1055/2125] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:04 2022] DELETE /identity/v3/users/aa27daf998904db784dd2110f8274285 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:04.999831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:05.001531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:05.011347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1071/2126] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:04 2022] DELETE /identity/v3/users/6b7fb550d29d4198b8337426cd108cdd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:05.012232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:05.013864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:05.085199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ed21f-736d-415c-a46c-572eaec52670 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:05.109483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9259c-9f55-4e0d-9bce-2ff2fd0d9f05 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:05.115901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:05.116452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.116737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.117012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] PATH_INFO: `/v3/users/8184cbc4128c4025bfa88223b1bb028a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.118376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8184cbc4128c4025bfa88223b1bb028a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:05.121166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:05.189175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b5081-2239-40ec-9a7e-7978875e465a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:05.190185 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b5081-2239-40ec-9a7e-7978875e465a admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.190660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b5081-2239-40ec-9a7e-7978875e465a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.191090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b5081-2239-40ec-9a7e-7978875e465a admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.193016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8184cbc4128c4025bfa88223b1bb028a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:05.193747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8184cbc4128c4025bfa88223b1bb028a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:05.194158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b5081-2239-40ec-9a7e-7978875e465a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:05.194868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8184cbc4128c4025bfa88223b1bb028a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:05.196485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b5081-2239-40ec-9a7e-7978875e465a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:05.211327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8184cbc4128c4025bfa88223b1bb028a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:05.211489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1056/2127] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:05.215409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcd5e2-2f3d-4071-8993-167a6ba29b0b None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.215409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcd5e2-2f3d-4071-8993-167a6ba29b0b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.215409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcd5e2-2f3d-4071-8993-167a6ba29b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.235870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f8b5fadf-6b85-4f87-a21d-2967ff699078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8184cbc4128c4025bfa88223b1bb028a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:05.236509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c9dcd5e2-2f3d-4071-8993-167a6ba29b0b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:05.237777 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c9dcd5e2-2f3d-4071-8993-167a6ba29b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:05.251731 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1057/2128] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:05.252449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcd5e2-2f3d-4071-8993-167a6ba29b0b None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:05.253987 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c9dcd5e2-2f3d-4071-8993-167a6ba29b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:05.268390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcd5e2-2f3d-4071-8993-167a6ba29b0b None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:05.273027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1072/2129] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:05 2022] DELETE /identity/v3/users/8184cbc4128c4025bfa88223b1bb028a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:05.275001 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b602532-d048-4a2f-a107-1585ee337899 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.275296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b602532-d048-4a2f-a107-1585ee337899 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.275581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b602532-d048-4a2f-a107-1585ee337899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.310436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2b602532-d048-4a2f-a107-1585ee337899 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:05.328682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2b602532-d048-4a2f-a107-1585ee337899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:05.374190 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56a36f-b047-40e3-9889-8f1e5197a510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:05.376434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56a36f-b047-40e3-9889-8f1e5197a510 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.376902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56a36f-b047-40e3-9889-8f1e5197a510 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.377887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56a36f-b047-40e3-9889-8f1e5197a510 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.378998 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56a36f-b047-40e3-9889-8f1e5197a510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:05.383364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56a36f-b047-40e3-9889-8f1e5197a510 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:05.402802 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1058/2130] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:05.402802 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56a36f-b047-40e3-9889-8f1e5197a510 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:05.412892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0a56a36f-b047-40e3-9889-8f1e5197a510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:05.424560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1073/2131] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:05.425650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b602532-d048-4a2f-a107-1585ee337899 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:05.437294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b602532-d048-4a2f-a107-1585ee337899 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:05.467745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797eb31-fe36-45c9-a667-8f17dcee9620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:05.468660 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797eb31-fe36-45c9-a667-8f17dcee9620 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.468946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797eb31-fe36-45c9-a667-8f17dcee9620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.469237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797eb31-fe36-45c9-a667-8f17dcee9620 admin admin] PATH_INFO: `/v3/projects/397aaa6cfb2a4e58b37fc5e358b9aa2a/users/d743b85c9e554d93b9bc8ab528e0769a/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.489678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797eb31-fe36-45c9-a667-8f17dcee9620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397aaa6cfb2a4e58b37fc5e358b9aa2a, user_id=d743b85c9e554d93b9bc8ab528e0769a, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:05.492543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797eb31-fe36-45c9-a667-8f17dcee9620 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:05.515160 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1074/2132] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:05 2022] PUT /identity/v3/projects/397aaa6cfb2a4e58b37fc5e358b9aa2a/users/d743b85c9e554d93b9bc8ab528e0769a/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:05.525098 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56a36f-b047-40e3-9889-8f1e5197a510 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:05.528835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797eb31-fe36-45c9-a667-8f17dcee9620 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:05.600782 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c4685-6a7e-4518-9222-578f4c58defb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:05.605555 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4685-6a7e-4518-9222-578f4c58defb service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.605851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4685-6a7e-4518-9222-578f4c58defb service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.606375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c4685-6a7e-4518-9222-578f4c58defb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.646065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797eb31-fe36-45c9-a667-8f17dcee9620 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:05.653019 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fa731-2f2b-4f58-869c-be350c2a7d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:05.653702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fa731-2f2b-4f58-869c-be350c2a7d19 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.653994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fa731-2f2b-4f58-869c-be350c2a7d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.654271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fa731-2f2b-4f58-869c-be350c2a7d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.743187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c4685-6a7e-4518-9222-578f4c58defb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:05.744942 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c4685-6a7e-4518-9222-578f4c58defb service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:05.767834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1059/2133] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:05.769224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800ff58-82b8-4ef2-8ee5-6620f92ad860 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.769505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800ff58-82b8-4ef2-8ee5-6620f92ad860 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.776598 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800ff58-82b8-4ef2-8ee5-6620f92ad860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.785842 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fa731-2f2b-4f58-869c-be350c2a7d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:05.788189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fa731-2f2b-4f58-869c-be350c2a7d19 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:05.806649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1075/2134] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:05.808276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fa731-2f2b-4f58-869c-be350c2a7d19 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:05.810098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-009fa731-2f2b-4f58-869c-be350c2a7d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:05.827058 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fa731-2f2b-4f58-869c-be350c2a7d19 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:05.834679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:05.836638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.837278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.837859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] PATH_INFO: `/v3/projects/b6dba07a79af4a229e00af26d89351b5` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.840597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6dba07a79af4a229e00af26d89351b5)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:05.843202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:05.843875 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3800ff58-82b8-4ef2-8ee5-6620f92ad860 None None] MFA Rules not processed for user `d743b85c9e554d93b9bc8ab528e0769a`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:05.847345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3800ff58-82b8-4ef2-8ee5-6620f92ad860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:05.913344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6dba07a79af4a229e00af26d89351b5', 'request_id': 'req-002594bb-7ffc-4527-822b-3bd89c0a9401'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:05.924746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6dba07a79af4a229e00af26d89351b5', 'request_id': 'req-002594bb-7ffc-4527-822b-3bd89c0a9401'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:05.935187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6dba07a79af4a229e00af26d89351b5', 'request_id': 'req-002594bb-7ffc-4527-822b-3bd89c0a9401'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:05.950622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] The token cache is being invalidate because project b6dba07a79af4a229e00af26d89351b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:05.951154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:05.952014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-002594bb-7ffc-4527-822b-3bd89c0a9401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:05.954685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1076/2135] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:05 2022] DELETE /identity/v3/projects/b6dba07a79af4a229e00af26d89351b5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:05.961133 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620347-80bc-4fc9-8535-3ef0c8e2b099 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:05.961262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1060/2136] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:05.961665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620347-80bc-4fc9-8535-3ef0c8e2b099 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:05.962041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93620347-80bc-4fc9-8535-3ef0c8e2b099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:05.962170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800ff58-82b8-4ef2-8ee5-6620f92ad860 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:05.978295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800ff58-82b8-4ef2-8ee5-6620f92ad860 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.011735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-93620347-80bc-4fc9-8535-3ef0c8e2b099 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:06.017039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-93620347-80bc-4fc9-8535-3ef0c8e2b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:06.084569 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55885b9-7cfb-478f-8a27-725ebb7d59eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.085293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55885b9-7cfb-478f-8a27-725ebb7d59eb admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.085547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55885b9-7cfb-478f-8a27-725ebb7d59eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.085879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55885b9-7cfb-478f-8a27-725ebb7d59eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.086585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55885b9-7cfb-478f-8a27-725ebb7d59eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.088756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55885b9-7cfb-478f-8a27-725ebb7d59eb admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.126409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1061/2137] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:05 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:06.131916 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55885b9-7cfb-478f-8a27-725ebb7d59eb admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.135409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f55885b9-7cfb-478f-8a27-725ebb7d59eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:06.156986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1077/2138] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:06.165515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab2c56-0c0b-4f62-a023-570c387fc39b None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.165851 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab2c56-0c0b-4f62-a023-570c387fc39b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.166131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab2c56-0c0b-4f62-a023-570c387fc39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.208568 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-07ab2c56-0c0b-4f62-a023-570c387fc39b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:06.209782 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-07ab2c56-0c0b-4f62-a023-570c387fc39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:06.227114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55885b9-7cfb-478f-8a27-725ebb7d59eb admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.240527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1078/2139] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:06.241911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab2c56-0c0b-4f62-a023-570c387fc39b None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.260239 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c785a0-b320-45ea-bb80-18b751e9eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.265291 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab2c56-0c0b-4f62-a023-570c387fc39b None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.265804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c785a0-b320-45ea-bb80-18b751e9eaea admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.266246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c785a0-b320-45ea-bb80-18b751e9eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.266534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c785a0-b320-45ea-bb80-18b751e9eaea admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.267539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c785a0-b320-45ea-bb80-18b751e9eaea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.269968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c785a0-b320-45ea-bb80-18b751e9eaea admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.287633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898512c-6001-4fdc-bc38-7235e316754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.288347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898512c-6001-4fdc-bc38-7235e316754a admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.288632 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898512c-6001-4fdc-bc38-7235e316754a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.288910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898512c-6001-4fdc-bc38-7235e316754a admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.289675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898512c-6001-4fdc-bc38-7235e316754a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:06.289992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898512c-6001-4fdc-bc38-7235e316754a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.292182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898512c-6001-4fdc-bc38-7235e316754a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.298989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1062/2140] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:06 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:06.300123 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c785a0-b320-45ea-bb80-18b751e9eaea admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.315135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c785a0-b320-45ea-bb80-18b751e9eaea admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.320382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a256c-52c6-4292-a2a8-59599f5b8838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.321300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a256c-52c6-4292-a2a8-59599f5b8838 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.321556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a256c-52c6-4292-a2a8-59599f5b8838 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.321911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a256c-52c6-4292-a2a8-59599f5b8838 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.322679 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a256c-52c6-4292-a2a8-59599f5b8838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.327642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1079/2141] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:06.328326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a256c-52c6-4292-a2a8-59599f5b8838 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.329040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898512c-6001-4fdc-bc38-7235e316754a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.344035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1063/2142] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:06.344904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a256c-52c6-4292-a2a8-59599f5b8838 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.347724 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898512c-6001-4fdc-bc38-7235e316754a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.357179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a256c-52c6-4292-a2a8-59599f5b8838 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.360949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b5d0-657b-49c3-ac22-f90c158a39b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.361662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b5d0-657b-49c3-ac22-f90c158a39b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.361953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b5d0-657b-49c3-ac22-f90c158a39b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.362280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7b5d0-657b-49c3-ac22-f90c158a39b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.362551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d29934-930e-4f4c-b309-2872ae31aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.362916 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7b5d0-657b-49c3-ac22-f90c158a39b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.363624 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29934-930e-4f4c-b309-2872ae31aafc admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.363975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29934-930e-4f4c-b309-2872ae31aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.364372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29934-930e-4f4c-b309-2872ae31aafc admin admin] PATH_INFO: `/v3/projects/8faa026bbdc6425c851f931ad88f61ea/users/ea5d73f3975a4fbbba8944125ec61b92/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.364833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7b5d0-657b-49c3-ac22-f90c158a39b6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.415384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1080/2143] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:06 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:06.419549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b5d0-657b-49c3-ac22-f90c158a39b6 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.422540 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d29934-930e-4f4c-b309-2872ae31aafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8faa026bbdc6425c851f931ad88f61ea, user_id=ea5d73f3975a4fbbba8944125ec61b92, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.425279 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d29934-930e-4f4c-b309-2872ae31aafc admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.449432 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1064/2144] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:06 2022] PUT /identity/v3/projects/8faa026bbdc6425c851f931ad88f61ea/users/ea5d73f3975a4fbbba8944125ec61b92/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:56:06.453539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d29934-930e-4f4c-b309-2872ae31aafc admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.588975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7b5d0-657b-49c3-ac22-f90c158a39b6 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.607637 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d29934-930e-4f4c-b309-2872ae31aafc admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.617355 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d31f1-e31d-4ccd-a783-64b20948cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.620164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d31f1-e31d-4ccd-a783-64b20948cea7 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.620712 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d31f1-e31d-4ccd-a783-64b20948cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.621525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d31f1-e31d-4ccd-a783-64b20948cea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.622321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d31f1-e31d-4ccd-a783-64b20948cea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.624246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d31f1-e31d-4ccd-a783-64b20948cea7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.629874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29675f16-c9a8-434c-ab09-30402f98b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.630905 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29675f16-c9a8-434c-ab09-30402f98b16c admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.631023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29675f16-c9a8-434c-ab09-30402f98b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.631242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29675f16-c9a8-434c-ab09-30402f98b16c admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.631973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29675f16-c9a8-434c-ab09-30402f98b16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.643994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1065/2145] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:06.644872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d31f1-e31d-4ccd-a783-64b20948cea7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.646646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f45d31f1-e31d-4ccd-a783-64b20948cea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:06.650417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29675f16-c9a8-434c-ab09-30402f98b16c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.660165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d31f1-e31d-4ccd-a783-64b20948cea7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.666570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.667691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.668013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.668263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] PATH_INFO: `/v3/projects/dc82edc38ad346b9a571cc24031c4fcb` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.683915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1081/2146] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:06 2022] POST /identity/v3/users => generated 291 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:06.685339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29675f16-c9a8-434c-ab09-30402f98b16c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.690732 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc82edc38ad346b9a571cc24031c4fcb)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.691132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-29675f16-c9a8-434c-ab09-30402f98b16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:06.694853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.740742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29675f16-c9a8-434c-ab09-30402f98b16c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.749513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.750492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.750825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.751098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] PATH_INFO: `/v3/projects/4fabb27e899f4559b641000451899d2b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.752417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fabb27e899f4559b641000451899d2b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.754574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.767116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc82edc38ad346b9a571cc24031c4fcb', 'request_id': 'req-1f651016-91ca-4965-80dc-1427dacbdf6a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:06.776382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc82edc38ad346b9a571cc24031c4fcb', 'request_id': 'req-1f651016-91ca-4965-80dc-1427dacbdf6a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:06.785159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc82edc38ad346b9a571cc24031c4fcb', 'request_id': 'req-1f651016-91ca-4965-80dc-1427dacbdf6a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:06.804096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] The token cache is being invalidate because project dc82edc38ad346b9a571cc24031c4fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:06.804658 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:06.805732 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:06.811993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1066/2147] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:06 2022] DELETE /identity/v3/projects/dc82edc38ad346b9a571cc24031c4fcb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:06.811993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.812868 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:06.815665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fabb27e899f4559b641000451899d2b', 'request_id': 'req-0800dec3-7745-48f2-8194-9300bb1820b5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:06.822038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fabb27e899f4559b641000451899d2b', 'request_id': 'req-0800dec3-7745-48f2-8194-9300bb1820b5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:06.832712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fabb27e899f4559b641000451899d2b', 'request_id': 'req-0800dec3-7745-48f2-8194-9300bb1820b5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:06.843628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] The token cache is being invalidate because project 4fabb27e899f4559b641000451899d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:06.844089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:06.844832 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:06.846885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1082/2148] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:06 2022] DELETE /identity/v3/projects/4fabb27e899f4559b641000451899d2b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:06.847512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.848898 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:06.905781 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f651016-91ca-4965-80dc-1427dacbdf6a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.925491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800dec3-7745-48f2-8194-9300bb1820b5 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.931886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5126bc-4648-4917-8167-8380abea1f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.933109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5126bc-4648-4917-8167-8380abea1f1f admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.933447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5126bc-4648-4917-8167-8380abea1f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.933766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5126bc-4648-4917-8167-8380abea1f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.934566 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5126bc-4648-4917-8167-8380abea1f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.936296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5126bc-4648-4917-8167-8380abea1f1f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.951212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1083/2149] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:06.951212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5126bc-4648-4917-8167-8380abea1f1f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:06.953365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9f5126bc-4648-4917-8167-8380abea1f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:06.968921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5126bc-4648-4917-8167-8380abea1f1f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:06.974052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.976627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.976932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.977288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] PATH_INFO: `/v3/users/514e1d2d01b04813999205d71f3edb08` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.978749 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=514e1d2d01b04813999205d71f3edb08)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.981506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:06.982011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8027b0-a589-4fa2-aa30-ae7027e531f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:06.983004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8027b0-a589-4fa2-aa30-ae7027e531f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:06.983347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8027b0-a589-4fa2-aa30-ae7027e531f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:06.983702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8027b0-a589-4fa2-aa30-ae7027e531f7 admin admin] PATH_INFO: `/v3/projects/8faa026bbdc6425c851f931ad88f61ea/users/ea5d73f3975a4fbbba8944125ec61b92/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:06.986212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8027b0-a589-4fa2-aa30-ae7027e531f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8faa026bbdc6425c851f931ad88f61ea, user_id=ea5d73f3975a4fbbba8944125ec61b92, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:06.996564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8027b0-a589-4fa2-aa30-ae7027e531f7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:07.013785 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1067/2150] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:06 2022] PUT /identity/v3/projects/8faa026bbdc6425c851f931ad88f61ea/users/ea5d73f3975a4fbbba8944125ec61b92/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:07.016333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14e4af-2c81-4b04-ab78-6ce8491214f4 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.019740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14e4af-2c81-4b04-ab78-6ce8491214f4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.020066 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14e4af-2c81-4b04-ab78-6ce8491214f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.039694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514e1d2d01b04813999205d71f3edb08'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:07.040701 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514e1d2d01b04813999205d71f3edb08'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:07.041473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514e1d2d01b04813999205d71f3edb08'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:07.058708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514e1d2d01b04813999205d71f3edb08'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:07.066446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-9d14e4af-2c81-4b04-ab78-6ce8491214f4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:07.067933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9d14e4af-2c81-4b04-ab78-6ce8491214f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:07.073811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514e1d2d01b04813999205d71f3edb08'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:07.095639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1084/2151] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:06 2022] DELETE /identity/v3/users/514e1d2d01b04813999205d71f3edb08 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:07.096685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:07.098431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:07.162747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1068/2152] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:07.164904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de6d9-7daf-45fc-b274-8fb6c8261c55 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.165597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de6d9-7daf-45fc-b274-8fb6c8261c55 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.166088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7de6d9-7daf-45fc-b274-8fb6c8261c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.212690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-4e7de6d9-7daf-45fc-b274-8fb6c8261c55 None None] MFA Rules not processed for user `ea5d73f3975a4fbbba8944125ec61b92`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:07.215130 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f837ba-081c-4511-923e-1f4aefbd8508 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:07.216304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4e7de6d9-7daf-45fc-b274-8fb6c8261c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:07.220196 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aef291-86c1-4baf-8a48-25ae3dce59ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:07.220919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef291-86c1-4baf-8a48-25ae3dce59ed admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.221344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef291-86c1-4baf-8a48-25ae3dce59ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.221718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef291-86c1-4baf-8a48-25ae3dce59ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.222529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aef291-86c1-4baf-8a48-25ae3dce59ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:07.224409 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aef291-86c1-4baf-8a48-25ae3dce59ed admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:07.237993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1085/2153] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:07.242729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63f91-0c4f-45ab-b52b-1f8df230dbdf None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.243103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63f91-0c4f-45ab-b52b-1f8df230dbdf None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.243452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63f91-0c4f-45ab-b52b-1f8df230dbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.263077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3da63f91-0c4f-45ab-b52b-1f8df230dbdf None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:07.265027 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3da63f91-0c4f-45ab-b52b-1f8df230dbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:07.281779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1086/2154] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:07.281779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da63f91-0c4f-45ab-b52b-1f8df230dbdf None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:07.288469 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da63f91-0c4f-45ab-b52b-1f8df230dbdf None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:07.314134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fe37b-cabf-49a1-8dcd-63e6f33a2879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:07.315354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fe37b-cabf-49a1-8dcd-63e6f33a2879 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.315994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fe37b-cabf-49a1-8dcd-63e6f33a2879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.316489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fe37b-cabf-49a1-8dcd-63e6f33a2879 admin admin] PATH_INFO: `/v3/projects/f9685cb758204c8796b385ebb2e69883/users/6957f83771574e93aea26204f40a32fb/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.338909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fe37b-cabf-49a1-8dcd-63e6f33a2879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9685cb758204c8796b385ebb2e69883, user_id=6957f83771574e93aea26204f40a32fb, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:07.341964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fe37b-cabf-49a1-8dcd-63e6f33a2879 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:07.348237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1069/2155] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:07.356209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de6d9-7daf-45fc-b274-8fb6c8261c55 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:07.367801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7de6d9-7daf-45fc-b274-8fb6c8261c55 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:07.379652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1087/2156] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:07 2022] PUT /identity/v3/projects/f9685cb758204c8796b385ebb2e69883/users/6957f83771574e93aea26204f40a32fb/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:07.380569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fe37b-cabf-49a1-8dcd-63e6f33a2879 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:07.383141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-773fe37b-cabf-49a1-8dcd-63e6f33a2879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:07.452787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb393c-e477-464f-a0cd-dd4706e1dc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:07.453482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb393c-e477-464f-a0cd-dd4706e1dc26 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.453964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb393c-e477-464f-a0cd-dd4706e1dc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.454251 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb393c-e477-464f-a0cd-dd4706e1dc26 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.454992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb393c-e477-464f-a0cd-dd4706e1dc26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:07.455327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb393c-e477-464f-a0cd-dd4706e1dc26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:07.458065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb393c-e477-464f-a0cd-dd4706e1dc26 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:07.475875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fe37b-cabf-49a1-8dcd-63e6f33a2879 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:07.476410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1070/2157] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:07.478568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2711d-0fe8-420b-9a61-047ad570d5c7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.478925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2711d-0fe8-420b-9a61-047ad570d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.479722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2711d-0fe8-420b-9a61-047ad570d5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.485064 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca4430-0ae9-4d30-9377-54381799a3f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:07.486271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4430-0ae9-4d30-9377-54381799a3f1 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.486994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4430-0ae9-4d30-9377-54381799a3f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.487382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca4430-0ae9-4d30-9377-54381799a3f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.490480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-69ca4430-0ae9-4d30-9377-54381799a3f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:07.515423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-8ac2711d-0fe8-420b-9a61-047ad570d5c7 None None] MFA Rules not processed for user `6957f83771574e93aea26204f40a32fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:07.517191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8ac2711d-0fe8-420b-9a61-047ad570d5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:07.592955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca4430-0ae9-4d30-9377-54381799a3f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:07.595733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca4430-0ae9-4d30-9377-54381799a3f1 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:07.609372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1071/2158] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:07.610562 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2711d-0fe8-420b-9a61-047ad570d5c7 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:07.610708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1088/2159] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:07.611626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca4430-0ae9-4d30-9377-54381799a3f1 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:07.615932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-69ca4430-0ae9-4d30-9377-54381799a3f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:07.632084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca4430-0ae9-4d30-9377-54381799a3f1 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:07.638445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:07.639666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.640159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.640652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] PATH_INFO: `/v3/projects/863655445e6a4cbd9bc3f1ec241aff89` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.640897 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2711d-0fe8-420b-9a61-047ad570d5c7 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:07.642351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863655445e6a4cbd9bc3f1ec241aff89)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:07.644527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:07.649969 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa72e9-77be-43ee-adb9-312873f6c335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:07.651730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa72e9-77be-43ee-adb9-312873f6c335 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.652386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa72e9-77be-43ee-adb9-312873f6c335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.652885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa72e9-77be-43ee-adb9-312873f6c335 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.654916 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa72e9-77be-43ee-adb9-312873f6c335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:07.674598 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa72e9-77be-43ee-adb9-312873f6c335 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:07.716568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1072/2160] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:07 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:07.717528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa72e9-77be-43ee-adb9-312873f6c335 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:07.742743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863655445e6a4cbd9bc3f1ec241aff89', 'request_id': 'req-d6651823-9f91-471e-87ae-ebe466467536'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:07.755310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863655445e6a4cbd9bc3f1ec241aff89', 'request_id': 'req-d6651823-9f91-471e-87ae-ebe466467536'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:07.772231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863655445e6a4cbd9bc3f1ec241aff89', 'request_id': 'req-d6651823-9f91-471e-87ae-ebe466467536'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:07.786314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] The token cache is being invalidate because project 863655445e6a4cbd9bc3f1ec241aff89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:07.786607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:07.787293 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:07.788938 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1089/2161] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:07 2022] DELETE /identity/v3/projects/863655445e6a4cbd9bc3f1ec241aff89 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:07.789932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:07.792410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:07.847968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa72e9-77be-43ee-adb9-312873f6c335 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:07.853712 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802508c-da44-4540-96b9-9c77f3ffbb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:07.854976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802508c-da44-4540-96b9-9c77f3ffbb03 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.855262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802508c-da44-4540-96b9-9c77f3ffbb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.855541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802508c-da44-4540-96b9-9c77f3ffbb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.856937 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802508c-da44-4540-96b9-9c77f3ffbb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:07.858955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802508c-da44-4540-96b9-9c77f3ffbb03 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:07.896600 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1073/2162] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:07 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:07.898282 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9266cec-a736-4cc1-84f0-b36055ccd880 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:07.898574 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9266cec-a736-4cc1-84f0-b36055ccd880 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:07.898858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9266cec-a736-4cc1-84f0-b36055ccd880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:07.901607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6651823-9f91-471e-87ae-ebe466467536 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:07.931934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-a9266cec-a736-4cc1-84f0-b36055ccd880 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:07.936447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a9266cec-a736-4cc1-84f0-b36055ccd880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:08.025210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cb4ab-cb36-452d-9422-260ef69c7588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.026945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cb4ab-cb36-452d-9422-260ef69c7588 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.027518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cb4ab-cb36-452d-9422-260ef69c7588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.028022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cb4ab-cb36-452d-9422-260ef69c7588 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.029255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cb4ab-cb36-452d-9422-260ef69c7588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.035937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cb4ab-cb36-452d-9422-260ef69c7588 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.070030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1074/2163] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:08.071014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9266cec-a736-4cc1-84f0-b36055ccd880 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.087851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a9266cec-a736-4cc1-84f0-b36055ccd880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:08.109192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9266cec-a736-4cc1-84f0-b36055ccd880 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.118872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a6196-f800-493d-9f59-11e9dbb6606e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.120803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1090/2164] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:07 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:08.124235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d2e11-8eea-4573-94aa-c1028bf15969 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.124235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d2e11-8eea-4573-94aa-c1028bf15969 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.124892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6196-f800-493d-9f59-11e9dbb6606e admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.125541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6196-f800-493d-9f59-11e9dbb6606e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.125869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a6196-f800-493d-9f59-11e9dbb6606e admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.127018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a6196-f800-493d-9f59-11e9dbb6606e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.129717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d2e11-8eea-4573-94aa-c1028bf15969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.129844 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a6196-f800-493d-9f59-11e9dbb6606e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.165888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1075/2165] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:08 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:08.166846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a6196-f800-493d-9f59-11e9dbb6606e admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.179759 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a6196-f800-493d-9f59-11e9dbb6606e admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.194223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-fc3d2e11-8eea-4573-94aa-c1028bf15969 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:08.203881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790f77f-7dd3-4765-949c-14b41610274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.205670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f77f-7dd3-4765-949c-14b41610274e admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.207176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f77f-7dd3-4765-949c-14b41610274e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.207579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790f77f-7dd3-4765-949c-14b41610274e admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.208327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-fc3d2e11-8eea-4573-94aa-c1028bf15969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:08.208922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790f77f-7dd3-4765-949c-14b41610274e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.216001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790f77f-7dd3-4765-949c-14b41610274e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.222657 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1091/2166] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:08.223941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d2e11-8eea-4573-94aa-c1028bf15969 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.236597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d2e11-8eea-4573-94aa-c1028bf15969 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.241787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1076/2167] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:08.243920 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790f77f-7dd3-4765-949c-14b41610274e admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.248013 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a02ceb-a768-4731-bfba-668ec980ebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.248721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02ceb-a768-4731-bfba-668ec980ebe8 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.249014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02ceb-a768-4731-bfba-668ec980ebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.249286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a02ceb-a768-4731-bfba-668ec980ebe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.250164 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a02ceb-a768-4731-bfba-668ec980ebe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.251911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a02ceb-a768-4731-bfba-668ec980ebe8 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.266131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1092/2168] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:08.267260 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a02ceb-a768-4731-bfba-668ec980ebe8 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.270526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790f77f-7dd3-4765-949c-14b41610274e admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.278682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a02ceb-a768-4731-bfba-668ec980ebe8 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.280434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc3032-f2ad-424b-96c1-3b8c14e0333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.281189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc3032-f2ad-424b-96c1-3b8c14e0333b admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.281482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc3032-f2ad-424b-96c1-3b8c14e0333b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.281774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc3032-f2ad-424b-96c1-3b8c14e0333b admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.282511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc3032-f2ad-424b-96c1-3b8c14e0333b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:08.282821 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc3032-f2ad-424b-96c1-3b8c14e0333b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.284628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc3032-f2ad-424b-96c1-3b8c14e0333b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.287734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4eb19-40cb-44d6-b69d-54c3844ce2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.288423 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4eb19-40cb-44d6-b69d-54c3844ce2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.288708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4eb19-40cb-44d6-b69d-54c3844ce2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.288982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4eb19-40cb-44d6-b69d-54c3844ce2d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.289747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4eb19-40cb-44d6-b69d-54c3844ce2d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.291383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4eb19-40cb-44d6-b69d-54c3844ce2d3 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.297827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1077/2169] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:08.298669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc3032-f2ad-424b-96c1-3b8c14e0333b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.307676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1093/2170] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:08.308848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4eb19-40cb-44d6-b69d-54c3844ce2d3 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.310194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc3032-f2ad-424b-96c1-3b8c14e0333b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.315462 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d83f3-264a-4c77-a519-b880533f9751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.317308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d83f3-264a-4c77-a519-b880533f9751 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.317308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d83f3-264a-4c77-a519-b880533f9751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.317308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d83f3-264a-4c77-a519-b880533f9751 admin admin] PATH_INFO: `/v3/projects/ee9a407972fe4e3181ecee9484b58f98/users/a943f57add9743649d9b0f09a3db2c24/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.324366 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4eb19-40cb-44d6-b69d-54c3844ce2d3 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.336929 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd15e9-5c52-4e08-8395-5faed2f54ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.337784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd15e9-5c52-4e08-8395-5faed2f54ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.337968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd15e9-5c52-4e08-8395-5faed2f54ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.338238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd15e9-5c52-4e08-8395-5faed2f54ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.339235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd15e9-5c52-4e08-8395-5faed2f54ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.340419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d83f3-264a-4c77-a519-b880533f9751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9a407972fe4e3181ecee9484b58f98, user_id=a943f57add9743649d9b0f09a3db2c24, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.341381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd15e9-5c52-4e08-8395-5faed2f54ca6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.342887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d83f3-264a-4c77-a519-b880533f9751 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.362316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1078/2171] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:08 2022] PUT /identity/v3/projects/ee9a407972fe4e3181ecee9484b58f98/users/a943f57add9743649d9b0f09a3db2c24/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:08.363128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d83f3-264a-4c77-a519-b880533f9751 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.381788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1094/2172] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:08 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:08.382820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd15e9-5c52-4e08-8395-5faed2f54ca6 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.438776 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d83f3-264a-4c77-a519-b880533f9751 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.456883 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd15e9-5c52-4e08-8395-5faed2f54ca6 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.461835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac241d0-77a1-4def-a3be-9692e3363c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.462435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac241d0-77a1-4def-a3be-9692e3363c60 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.462805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac241d0-77a1-4def-a3be-9692e3363c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.463152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac241d0-77a1-4def-a3be-9692e3363c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.464651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac241d0-77a1-4def-a3be-9692e3363c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.466499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac241d0-77a1-4def-a3be-9692e3363c60 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.477460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1095/2173] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:08.478410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac241d0-77a1-4def-a3be-9692e3363c60 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.490964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac241d0-77a1-4def-a3be-9692e3363c60 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.498535 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419457d-3535-4370-8147-b8ede26f4e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.499313 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419457d-3535-4370-8147-b8ede26f4e65 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.499599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419457d-3535-4370-8147-b8ede26f4e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.500112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419457d-3535-4370-8147-b8ede26f4e65 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.500820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419457d-3535-4370-8147-b8ede26f4e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.502721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a462038-ea2f-45e8-a83e-8ff3fa0ec7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.503258 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419457d-3535-4370-8147-b8ede26f4e65 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.503663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a462038-ea2f-45e8-a83e-8ff3fa0ec7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.503961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a462038-ea2f-45e8-a83e-8ff3fa0ec7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.504226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a462038-ea2f-45e8-a83e-8ff3fa0ec7cb admin admin] PATH_INFO: `/v3/projects/350266a82c7e42dda9770fe6873f7554/users/424eb9eb1c354a46bfc21f720e26a199/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.521446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a462038-ea2f-45e8-a83e-8ff3fa0ec7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=350266a82c7e42dda9770fe6873f7554, user_id=424eb9eb1c354a46bfc21f720e26a199, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.524111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a462038-ea2f-45e8-a83e-8ff3fa0ec7cb admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.527957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1096/2174] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:08 2022] POST /identity/v3/users => generated 290 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:08.528856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419457d-3535-4370-8147-b8ede26f4e65 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.539258 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419457d-3535-4370-8147-b8ede26f4e65 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.545634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1079/2175] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:08 2022] PUT /identity/v3/projects/350266a82c7e42dda9770fe6873f7554/users/424eb9eb1c354a46bfc21f720e26a199/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:08.554689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a462038-ea2f-45e8-a83e-8ff3fa0ec7cb admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.603172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51d54a-9402-46f8-8ff0-0c2a500d1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.604911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51d54a-9402-46f8-8ff0-0c2a500d1553 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.605185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51d54a-9402-46f8-8ff0-0c2a500d1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.605599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51d54a-9402-46f8-8ff0-0c2a500d1553 admin admin] PATH_INFO: `/v3/projects/ee9a407972fe4e3181ecee9484b58f98/users/a943f57add9743649d9b0f09a3db2c24/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.608097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51d54a-9402-46f8-8ff0-0c2a500d1553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9a407972fe4e3181ecee9484b58f98, user_id=a943f57add9743649d9b0f09a3db2c24, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.611605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51d54a-9402-46f8-8ff0-0c2a500d1553 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.626832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a462038-ea2f-45e8-a83e-8ff3fa0ec7cb admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.629773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1097/2176] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:08 2022] PUT /identity/v3/projects/ee9a407972fe4e3181ecee9484b58f98/users/a943f57add9743649d9b0f09a3db2c24/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:08.633366 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a56ac-6bc7-455d-bdd7-6521985e8778 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.634054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a56ac-6bc7-455d-bdd7-6521985e8778 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.634724 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a56ac-6bc7-455d-bdd7-6521985e8778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.669060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e66a56ac-6bc7-455d-bdd7-6521985e8778 None None] MFA Rules not processed for user `424eb9eb1c354a46bfc21f720e26a199`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:08.670327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e66a56ac-6bc7-455d-bdd7-6521985e8778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:08.695642 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac0303-d115-4543-b285-f67589807d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.696305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac0303-d115-4543-b285-f67589807d28 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.696589 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac0303-d115-4543-b285-f67589807d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.696862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac0303-d115-4543-b285-f67589807d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.697639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac0303-d115-4543-b285-f67589807d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.699343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac0303-d115-4543-b285-f67589807d28 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.709322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1080/2177] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:08.710724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b2a4-1ffb-4dc1-8734-068348d6e920 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.711005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b2a4-1ffb-4dc1-8734-068348d6e920 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.711279 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821b2a4-1ffb-4dc1-8734-068348d6e920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.738733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-0821b2a4-1ffb-4dc1-8734-068348d6e920 None None] MFA Rules not processed for user `a943f57add9743649d9b0f09a3db2c24`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:08.740119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0821b2a4-1ffb-4dc1-8734-068348d6e920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:08.740640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1098/2178] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:08.745279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a56ac-6bc7-455d-bdd7-6521985e8778 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.756017 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a56ac-6bc7-455d-bdd7-6521985e8778 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.760757 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faac73-7353-4590-9e66-7cb6d6714996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.761394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faac73-7353-4590-9e66-7cb6d6714996 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.761714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faac73-7353-4590-9e66-7cb6d6714996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.761980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faac73-7353-4590-9e66-7cb6d6714996 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.762730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faac73-7353-4590-9e66-7cb6d6714996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.764334 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faac73-7353-4590-9e66-7cb6d6714996 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.774639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1099/2179] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:08.775389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faac73-7353-4590-9e66-7cb6d6714996 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.778358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-95faac73-7353-4590-9e66-7cb6d6714996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:08.809512 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1081/2180] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:08.810514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821b2a4-1ffb-4dc1-8734-068348d6e920 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.820789 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821b2a4-1ffb-4dc1-8734-068348d6e920 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.826207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7f143-aa5b-4465-8308-73f92f10a90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.827104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7f143-aa5b-4465-8308-73f92f10a90c admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.827385 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7f143-aa5b-4465-8308-73f92f10a90c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.827662 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7f143-aa5b-4465-8308-73f92f10a90c admin admin] PATH_INFO: `/v3/projects/dc1f18440100494692144476cd4c9b0d/users/356f8968911d4087afaf33774b3564df/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.835426 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faac73-7353-4590-9e66-7cb6d6714996 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.839776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffd89a-4f3a-4d96-b5e9-40b18d3df11b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.840424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffd89a-4f3a-4d96-b5e9-40b18d3df11b service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.840709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffd89a-4f3a-4d96-b5e9-40b18d3df11b service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.840989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffd89a-4f3a-4d96-b5e9-40b18d3df11b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.843253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7f143-aa5b-4465-8308-73f92f10a90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1f18440100494692144476cd4c9b0d, user_id=356f8968911d4087afaf33774b3564df, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.845946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7f143-aa5b-4465-8308-73f92f10a90c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.849366 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffd89a-4f3a-4d96-b5e9-40b18d3df11b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:08.850926 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffd89a-4f3a-4d96-b5e9-40b18d3df11b service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:08.859558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1082/2181] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:08 2022] PUT /identity/v3/projects/dc1f18440100494692144476cd4c9b0d/users/356f8968911d4087afaf33774b3564df/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:08.860384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7f143-aa5b-4465-8308-73f92f10a90c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:08.861103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1100/2182] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:08.862059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d5a7f143-aa5b-4465-8308-73f92f10a90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:08.871121 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e14ed5-b32c-4092-b65c-57f1fe6ba9c1 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.871617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e14ed5-b32c-4092-b65c-57f1fe6ba9c1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.871903 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e14ed5-b32c-4092-b65c-57f1fe6ba9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.899177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b9e14ed5-b32c-4092-b65c-57f1fe6ba9c1 None None] MFA Rules not processed for user `356f8968911d4087afaf33774b3564df`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:08.900380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b9e14ed5-b32c-4092-b65c-57f1fe6ba9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:08.931677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7f143-aa5b-4465-8308-73f92f10a90c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:08.936122 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcbf24-0267-4ed0-8a80-10be3ae978cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:08.936915 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcbf24-0267-4ed0-8a80-10be3ae978cb service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:08.937208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcbf24-0267-4ed0-8a80-10be3ae978cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:08.937494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcbf24-0267-4ed0-8a80-10be3ae978cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:08.973908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1101/2183] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:08.978553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e14ed5-b32c-4092-b65c-57f1fe6ba9c1 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:09.003630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcbf24-0267-4ed0-8a80-10be3ae978cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:09.005332 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcbf24-0267-4ed0-8a80-10be3ae978cb service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:09.016824 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1083/2184] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:09.049297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e14ed5-b32c-4092-b65c-57f1fe6ba9c1 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:09.054528 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670c1c0-95e4-4dee-88af-5cabb3f063d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:09.055210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670c1c0-95e4-4dee-88af-5cabb3f063d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:09.055497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670c1c0-95e4-4dee-88af-5cabb3f063d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:09.055776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670c1c0-95e4-4dee-88af-5cabb3f063d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:09.056481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670c1c0-95e4-4dee-88af-5cabb3f063d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:09.064940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670c1c0-95e4-4dee-88af-5cabb3f063d9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:09.100372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1102/2185] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:08 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:09.105620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcbf24-0267-4ed0-8a80-10be3ae978cb service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:09.129837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcbf24-0267-4ed0-8a80-10be3ae978cb service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:09.217392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d05900-441e-4d85-b0eb-102ca05f31a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:09.222269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d05900-441e-4d85-b0eb-102ca05f31a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:09.222815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d05900-441e-4d85-b0eb-102ca05f31a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:09.223126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d05900-441e-4d85-b0eb-102ca05f31a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:09.226719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d05900-441e-4d85-b0eb-102ca05f31a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:09.228800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d05900-441e-4d85-b0eb-102ca05f31a8 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:09.280727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1084/2186] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:09 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:09.282518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670c1c0-95e4-4dee-88af-5cabb3f063d9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:09.318518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670c1c0-95e4-4dee-88af-5cabb3f063d9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:09.348816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894faec-74da-486b-81d4-a821a8dadf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:09.349755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894faec-74da-486b-81d4-a821a8dadf2c admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:09.350047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894faec-74da-486b-81d4-a821a8dadf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:09.350481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894faec-74da-486b-81d4-a821a8dadf2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:09.351362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894faec-74da-486b-81d4-a821a8dadf2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:09.357829 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894faec-74da-486b-81d4-a821a8dadf2c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:09.380686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1103/2187] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:09.384852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d05900-441e-4d85-b0eb-102ca05f31a8 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:09.397138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d05900-441e-4d85-b0eb-102ca05f31a8 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:09.403602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe0a5-8aa1-451c-8246-56445ccec0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:09.404625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe0a5-8aa1-451c-8246-56445ccec0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:09.405058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe0a5-8aa1-451c-8246-56445ccec0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:09.405502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe0a5-8aa1-451c-8246-56445ccec0fb admin admin] PATH_INFO: `/v3/projects/cf07bf4006a4408a9d73afcda2ed3d3b/users/08254f48f41a4de8a1f90eb8c094d608/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:09.426763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efe0a5-8aa1-451c-8246-56445ccec0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf07bf4006a4408a9d73afcda2ed3d3b, user_id=08254f48f41a4de8a1f90eb8c094d608, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:09.430415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efe0a5-8aa1-451c-8246-56445ccec0fb admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:09.460350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1085/2188] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:09 2022] PUT /identity/v3/projects/cf07bf4006a4408a9d73afcda2ed3d3b/users/08254f48f41a4de8a1f90eb8c094d608/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:09.465138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894faec-74da-486b-81d4-a821a8dadf2c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:09.491852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894faec-74da-486b-81d4-a821a8dadf2c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:09.530905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe0a5-8aa1-451c-8246-56445ccec0fb admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:09.590405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f738e3-43a8-4cb6-930c-2a26af88bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:09.591407 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f738e3-43a8-4cb6-930c-2a26af88bf44 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:09.591773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f738e3-43a8-4cb6-930c-2a26af88bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:09.592186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f738e3-43a8-4cb6-930c-2a26af88bf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:09.593311 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f738e3-43a8-4cb6-930c-2a26af88bf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:09.596060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f738e3-43a8-4cb6-930c-2a26af88bf44 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:09.609813 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1104/2189] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:09.614048 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f738e3-43a8-4cb6-930c-2a26af88bf44 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:09.627136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f738e3-43a8-4cb6-930c-2a26af88bf44 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:09.636372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe0a5-8aa1-451c-8246-56445ccec0fb admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:09.636822 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27d52-feeb-47f5-9939-d0524c2ace2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:09.638820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27d52-feeb-47f5-9939-d0524c2ace2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:09.640263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27d52-feeb-47f5-9939-d0524c2ace2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:09.640547 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27d52-feeb-47f5-9939-d0524c2ace2f admin admin] PATH_INFO: `/v3/projects/cf07bf4006a4408a9d73afcda2ed3d3b/users/08254f48f41a4de8a1f90eb8c094d608/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:09.642097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c976-269a-4b76-93dd-0811a5a89518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:09.642878 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c976-269a-4b76-93dd-0811a5a89518 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:09.643239 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c976-269a-4b76-93dd-0811a5a89518 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:09.643465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27d52-feeb-47f5-9939-d0524c2ace2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf07bf4006a4408a9d73afcda2ed3d3b, user_id=08254f48f41a4de8a1f90eb8c094d608, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:09.643570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931c976-269a-4b76-93dd-0811a5a89518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:09.645989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7931c976-269a-4b76-93dd-0811a5a89518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:09.646997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27d52-feeb-47f5-9939-d0524c2ace2f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:09.666261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1105/2190] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:09 2022] PUT /identity/v3/projects/cf07bf4006a4408a9d73afcda2ed3d3b/users/08254f48f41a4de8a1f90eb8c094d608/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:56:09.679229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417c0e-26db-425f-96e5-46e9cd16b9f3 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:09.679525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417c0e-26db-425f-96e5-46e9cd16b9f3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:09.679797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e417c0e-26db-425f-96e5-46e9cd16b9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:09.726389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-1e417c0e-26db-425f-96e5-46e9cd16b9f3 None None] MFA Rules not processed for user `08254f48f41a4de8a1f90eb8c094d608`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:09.727852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1e417c0e-26db-425f-96e5-46e9cd16b9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:09.734784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931c976-269a-4b76-93dd-0811a5a89518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:09.736390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931c976-269a-4b76-93dd-0811a5a89518 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:09.747888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1086/2191] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:09.750451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c976-269a-4b76-93dd-0811a5a89518 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:09.765175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931c976-269a-4b76-93dd-0811a5a89518 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:09.814832 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1106/2192] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:09.831332 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417c0e-26db-425f-96e5-46e9cd16b9f3 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:09.868625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:09.869980 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:09.870501 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:09.870937 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] PATH_INFO: `/v3/users/6957f83771574e93aea26204f40a32fb` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:09.872569 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6957f83771574e93aea26204f40a32fb)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:09.874662 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:09.933629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e417c0e-26db-425f-96e5-46e9cd16b9f3 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:09.938264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763dbdf-a6f8-453a-b0e5-ab22daf83fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:09.939081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763dbdf-a6f8-453a-b0e5-ab22daf83fdc service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:09.939436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763dbdf-a6f8-453a-b0e5-ab22daf83fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:09.939788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763dbdf-a6f8-453a-b0e5-ab22daf83fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:09.951859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763dbdf-a6f8-453a-b0e5-ab22daf83fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:09.954081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763dbdf-a6f8-453a-b0e5-ab22daf83fdc service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:09.974313 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6957f83771574e93aea26204f40a32fb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:09.974651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1107/2193] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:09.975009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6957f83771574e93aea26204f40a32fb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:09.975805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6957f83771574e93aea26204f40a32fb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:09.985903 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6957f83771574e93aea26204f40a32fb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:10.015714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6957f83771574e93aea26204f40a32fb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:10.045866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1087/2194] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:09 2022] DELETE /identity/v3/users/6957f83771574e93aea26204f40a32fb => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:10.048784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76726f-9f88-425b-aa5d-ae8fa1d123c4 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:10.049634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76726f-9f88-425b-aa5d-ae8fa1d123c4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:10.050087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76726f-9f88-425b-aa5d-ae8fa1d123c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:10.074667 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-6b76726f-9f88-425b-aa5d-ae8fa1d123c4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:10.078605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6b76726f-9f88-425b-aa5d-ae8fa1d123c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:10.181193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1108/2195] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:10.195309 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:10.200988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:10.278357 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76726f-9f88-425b-aa5d-ae8fa1d123c4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:10.280335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6b76726f-9f88-425b-aa5d-ae8fa1d123c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:10.301278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76726f-9f88-425b-aa5d-ae8fa1d123c4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:10.308309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:10.309535 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:10.310300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:10.310725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] PATH_INFO: `/v3/users/1d465ffe97954b51bda034b2b8e0555c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:10.312447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d465ffe97954b51bda034b2b8e0555c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:10.315094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:10.326917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f29f6-4365-45d5-93e6-d476aa4e62ad admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:10.342912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764157-ea21-4ee7-8c3a-3907f5a23907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:10.343736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764157-ea21-4ee7-8c3a-3907f5a23907 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:10.344116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764157-ea21-4ee7-8c3a-3907f5a23907 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:10.344397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764157-ea21-4ee7-8c3a-3907f5a23907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:10.356063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f764157-ea21-4ee7-8c3a-3907f5a23907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:10.357941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f764157-ea21-4ee7-8c3a-3907f5a23907 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:10.370533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1088/2196] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:10.400500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d465ffe97954b51bda034b2b8e0555c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:10.401945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d465ffe97954b51bda034b2b8e0555c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:10.402603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d465ffe97954b51bda034b2b8e0555c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:10.430681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d465ffe97954b51bda034b2b8e0555c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:10.445870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d465ffe97954b51bda034b2b8e0555c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:10.468025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1109/2197] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:10 2022] DELETE /identity/v3/users/1d465ffe97954b51bda034b2b8e0555c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:10.501387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764157-ea21-4ee7-8c3a-3907f5a23907 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:10.503024 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7f764157-ea21-4ee7-8c3a-3907f5a23907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:10.675948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764157-ea21-4ee7-8c3a-3907f5a23907 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:10.775175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce5dc3-2e8b-4d58-bbd5-1d04c45d77f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08254f48f41a4de8a1f90eb8c094d608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf07bf4006a4408a9d73afcda2ed3d3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:10.776521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce5dc3-2e8b-4d58-bbd5-1d04c45d77f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:10.776774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce5dc3-2e8b-4d58-bbd5-1d04c45d77f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:10.778051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce5dc3-2e8b-4d58-bbd5-1d04c45d77f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:10.778909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce5dc3-2e8b-4d58-bbd5-1d04c45d77f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:10.779228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce5dc3-2e8b-4d58-bbd5-1d04c45d77f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:10.781530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce5dc3-2e8b-4d58-bbd5-1d04c45d77f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:10.799089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1089/2198] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:10.815041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:10.815041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:10.857873 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f58757-6787-4481-8da5-2e33648cbcfb admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:10.880341 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca945ead-9c21-4f89-946b-05051354b0ad tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08254f48f41a4de8a1f90eb8c094d608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf07bf4006a4408a9d73afcda2ed3d3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:10.880567 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce5dc3-2e8b-4d58-bbd5-1d04c45d77f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:10.881845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca945ead-9c21-4f89-946b-05051354b0ad tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:10.882671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca945ead-9c21-4f89-946b-05051354b0ad tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:10.882782 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c3ce5dc3-2e8b-4d58-bbd5-1d04c45d77f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:10.884538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca945ead-9c21-4f89-946b-05051354b0ad tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:10.886360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca945ead-9c21-4f89-946b-05051354b0ad tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:10.898207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca945ead-9c21-4f89-946b-05051354b0ad tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:10.967378 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce5dc3-2e8b-4d58-bbd5-1d04c45d77f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:10.971834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e456a2f-8997-41d3-95dd-7c6170dfa774 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:10.972833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e456a2f-8997-41d3-95dd-7c6170dfa774 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:10.973263 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e456a2f-8997-41d3-95dd-7c6170dfa774 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:10.973711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e456a2f-8997-41d3-95dd-7c6170dfa774 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:10.976694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2e456a2f-8997-41d3-95dd-7c6170dfa774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:10.997361 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1110/2199] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:10 2022] POST /identity/v3/projects => generated 353 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:10.999000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca945ead-9c21-4f89-946b-05051354b0ad tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:11.082103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e456a2f-8997-41d3-95dd-7c6170dfa774 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:11.085345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e456a2f-8997-41d3-95dd-7c6170dfa774 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:11.107058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1090/2200] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:11.108419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e456a2f-8997-41d3-95dd-7c6170dfa774 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:11.111241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2e456a2f-8997-41d3-95dd-7c6170dfa774 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:11.146815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca945ead-9c21-4f89-946b-05051354b0ad tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:11.157327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c5b93-5c7c-4208-ba0f-e1cd50773671 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08254f48f41a4de8a1f90eb8c094d608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf07bf4006a4408a9d73afcda2ed3d3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:11.158955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5b93-5c7c-4208-ba0f-e1cd50773671 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:11.159716 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5b93-5c7c-4208-ba0f-e1cd50773671 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:11.160455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c5b93-5c7c-4208-ba0f-e1cd50773671 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:11.162308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5b93-5c7c-4208-ba0f-e1cd50773671 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:11.163161 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5b93-5c7c-4208-ba0f-e1cd50773671 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:11.168084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899c5b93-5c7c-4208-ba0f-e1cd50773671 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:11.193908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1111/2201] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:11.195826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c5b93-5c7c-4208-ba0f-e1cd50773671 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:11.199436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-899c5b93-5c7c-4208-ba0f-e1cd50773671 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:11.267569 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e456a2f-8997-41d3-95dd-7c6170dfa774 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:11.315547 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c5b93-5c7c-4208-ba0f-e1cd50773671 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:11.321247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:11.323065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:11.323431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:11.325875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] PATH_INFO: `/v3/projects/c531ac9fcd864b999248adc77b852776` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:11.328045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c531ac9fcd864b999248adc77b852776)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:11.331506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:11.352463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:11.353346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:11.353663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:11.354188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] PATH_INFO: `/v3/projects/f9685cb758204c8796b385ebb2e69883` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:11.355599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9685cb758204c8796b385ebb2e69883)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:11.357609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:11.387407 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c531ac9fcd864b999248adc77b852776', 'request_id': 'req-b0c51eda-3917-420b-a57a-33fe9d9405b2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.399254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c531ac9fcd864b999248adc77b852776', 'request_id': 'req-b0c51eda-3917-420b-a57a-33fe9d9405b2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.409027 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9685cb758204c8796b385ebb2e69883', 'request_id': 'req-7af944f5-77e8-47e3-88b5-4addceb25b2a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.411385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c531ac9fcd864b999248adc77b852776', 'request_id': 'req-b0c51eda-3917-420b-a57a-33fe9d9405b2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.419794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9685cb758204c8796b385ebb2e69883', 'request_id': 'req-7af944f5-77e8-47e3-88b5-4addceb25b2a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.427476 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] The token cache is being invalidate because project c531ac9fcd864b999248adc77b852776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:11.427826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.428626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.430260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9685cb758204c8796b385ebb2e69883', 'request_id': 'req-7af944f5-77e8-47e3-88b5-4addceb25b2a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.430779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1112/2202] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:11 2022] DELETE /identity/v3/projects/c531ac9fcd864b999248adc77b852776 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:11.432779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:11.435096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:11.446714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] The token cache is being invalidate because project f9685cb758204c8796b385ebb2e69883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:11.447379 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.449148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7af944f5-77e8-47e3-88b5-4addceb25b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.451164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1091/2203] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:11 2022] DELETE /identity/v3/projects/f9685cb758204c8796b385ebb2e69883 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:11.455603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b6f0b-5ccf-415c-ac97-3e9634075bc4 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:11.455603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b6f0b-5ccf-415c-ac97-3e9634075bc4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:11.455603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b6f0b-5ccf-415c-ac97-3e9634075bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:11.477394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-2c6b6f0b-5ccf-415c-ac97-3e9634075bc4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:11.479609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2c6b6f0b-5ccf-415c-ac97-3e9634075bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:11.516998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c51eda-3917-420b-a57a-33fe9d9405b2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:11.556285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1092/2204] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:11.556770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b6f0b-5ccf-415c-ac97-3e9634075bc4 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:11.564825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2c6b6f0b-5ccf-415c-ac97-3e9634075bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:11.581727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b6f0b-5ccf-415c-ac97-3e9634075bc4 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:11.588046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:11.590116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:11.590565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:11.591010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] PATH_INFO: `/v3/users/a943f57add9743649d9b0f09a3db2c24` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:11.593027 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a943f57add9743649d9b0f09a3db2c24)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:11.596417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:11.602447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08254f48f41a4de8a1f90eb8c094d608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf07bf4006a4408a9d73afcda2ed3d3b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:11.603809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:11.604259 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:11.604710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] PATH_INFO: `/v3/projects/527af36cf57349b3b27adae8fa8b0113` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:11.606287 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: Authorizing `identity:delete_project(project_id=527af36cf57349b3b27adae8fa8b0113)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:11.609693 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:11.666365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a943f57add9743649d9b0f09a3db2c24'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.667260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a943f57add9743649d9b0f09a3db2c24'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.668129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a943f57add9743649d9b0f09a3db2c24'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.674807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527af36cf57349b3b27adae8fa8b0113', 'request_id': 'req-817a8fc9-70f8-49f8-968a-c81117dda3f0'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.677564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a943f57add9743649d9b0f09a3db2c24'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.684072 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527af36cf57349b3b27adae8fa8b0113', 'request_id': 'req-817a8fc9-70f8-49f8-968a-c81117dda3f0'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.695248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527af36cf57349b3b27adae8fa8b0113', 'request_id': 'req-817a8fc9-70f8-49f8-968a-c81117dda3f0'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.695656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-effb0e16-c78b-4f36-9249-2fe2fa799d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a943f57add9743649d9b0f09a3db2c24'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.711725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] The token cache is being invalidate because project 527af36cf57349b3b27adae8fa8b0113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:11.712093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.712867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:11.715483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1093/2205] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:11 2022] DELETE /identity/v3/users/a943f57add9743649d9b0f09a3db2c24 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:11.721180 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1113/2206] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:11 2022] DELETE /identity/v3/projects/527af36cf57349b3b27adae8fa8b0113 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:11.721543 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102630f-3260-42c2-a80c-b27f6e697b77 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:11.721543 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102630f-3260-42c2-a80c-b27f6e697b77 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:11.721543 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102630f-3260-42c2-a80c-b27f6e697b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:11.749202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f102630f-3260-42c2-a80c-b27f6e697b77 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:11.751291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f102630f-3260-42c2-a80c-b27f6e697b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:11.868872 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1094/2207] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:11.878004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.015228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8fc9-70f8-49f8-968a-c81117dda3f0 tempest-VolumeQuotaClassesTest-942472546 tempest-VolumeQuotaClassesTest-942472546-project-admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.024591 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b187d2-c8c7-47f3-9682-92256ed8e8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.025179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102630f-3260-42c2-a80c-b27f6e697b77 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.026480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b187d2-c8c7-47f3-9682-92256ed8e8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.027018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b187d2-c8c7-47f3-9682-92256ed8e8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.027771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b187d2-c8c7-47f3-9682-92256ed8e8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.029215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b187d2-c8c7-47f3-9682-92256ed8e8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:12.029733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f102630f-3260-42c2-a80c-b27f6e697b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.029850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b187d2-c8c7-47f3-9682-92256ed8e8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.032820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b187d2-c8c7-47f3-9682-92256ed8e8f8 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.065475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102630f-3260-42c2-a80c-b27f6e697b77 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.069044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1114/2208] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:12.071187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b187d2-c8c7-47f3-9682-92256ed8e8f8 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.075691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.076760 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.077450 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.077958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] PATH_INFO: `/v3/users/452716804e7e4425bcc575bf1c6431f4` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.079550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452716804e7e4425bcc575bf1c6431f4)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.082075 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.091359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b187d2-c8c7-47f3-9682-92256ed8e8f8 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.100519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf35844-76f1-42f6-9648-e19323412efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.101726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35844-76f1-42f6-9648-e19323412efa admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.102237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35844-76f1-42f6-9648-e19323412efa admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.102726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35844-76f1-42f6-9648-e19323412efa admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.105174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf35844-76f1-42f6-9648-e19323412efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.109507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf35844-76f1-42f6-9648-e19323412efa admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.159706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1115/2209] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:12 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:12.161240 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf35844-76f1-42f6-9648-e19323412efa admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.165426 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2cf35844-76f1-42f6-9648-e19323412efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.171772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452716804e7e4425bcc575bf1c6431f4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.172804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452716804e7e4425bcc575bf1c6431f4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.173769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452716804e7e4425bcc575bf1c6431f4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.203992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452716804e7e4425bcc575bf1c6431f4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.225855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452716804e7e4425bcc575bf1c6431f4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.247646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1095/2210] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:12 2022] DELETE /identity/v3/users/452716804e7e4425bcc575bf1c6431f4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:12.248503 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.249987 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.277049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf35844-76f1-42f6-9648-e19323412efa admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.351806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28410e-1b63-4b7e-b5e6-0a391d0aa389 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.357272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400392-6ba7-48ba-9250-58b48934ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.357970 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400392-6ba7-48ba-9250-58b48934ae0d admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.358246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400392-6ba7-48ba-9250-58b48934ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.358518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75400392-6ba7-48ba-9250-58b48934ae0d admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.359225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75400392-6ba7-48ba-9250-58b48934ae0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.361323 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75400392-6ba7-48ba-9250-58b48934ae0d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.370982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.371892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.372193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.372501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] PATH_INFO: `/v3/users/356f8968911d4087afaf33774b3564df` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.374840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=356f8968911d4087afaf33774b3564df)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.376770 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.386570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1096/2211] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:12 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:12.387526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400392-6ba7-48ba-9250-58b48934ae0d admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.399649 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-75400392-6ba7-48ba-9250-58b48934ae0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.416904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75400392-6ba7-48ba-9250-58b48934ae0d admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.423021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.424187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.424749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.425100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] PATH_INFO: `/v3/projects/ee9a407972fe4e3181ecee9484b58f98` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.426601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9a407972fe4e3181ecee9484b58f98)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.428522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.454590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356f8968911d4087afaf33774b3564df'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.455668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356f8968911d4087afaf33774b3564df'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.456846 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356f8968911d4087afaf33774b3564df'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.479834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356f8968911d4087afaf33774b3564df'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.485150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9a407972fe4e3181ecee9484b58f98', 'request_id': 'req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.490705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a9b5a260-8dcb-4096-a5cd-05d08433c6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356f8968911d4087afaf33774b3564df'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.492907 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9a407972fe4e3181ecee9484b58f98', 'request_id': 'req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.503196 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9a407972fe4e3181ecee9484b58f98', 'request_id': 'req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.509441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1116/2212] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:12 2022] DELETE /identity/v3/users/356f8968911d4087afaf33774b3564df => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:12.513797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c923b-7342-4194-9c3a-0e92b134dcb7 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.514108 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c923b-7342-4194-9c3a-0e92b134dcb7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.514359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c923b-7342-4194-9c3a-0e92b134dcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.518512 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] The token cache is being invalidate because project ee9a407972fe4e3181ecee9484b58f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:12.518891 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.519710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:12.521973 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1097/2213] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:12 2022] DELETE /identity/v3/projects/ee9a407972fe4e3181ecee9484b58f98 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:12.527941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.527941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.534976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-477c923b-7342-4194-9c3a-0e92b134dcb7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:12.537404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-477c923b-7342-4194-9c3a-0e92b134dcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.595530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4440b10-cfd6-49bb-8df2-f27d1c9b9362 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.631068 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1117/2214] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:12.632267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610012a4-00e4-4205-b664-6dd13a704b40 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.632550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610012a4-00e4-4205-b664-6dd13a704b40 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.632822 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610012a4-00e4-4205-b664-6dd13a704b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.663676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-610012a4-00e4-4205-b664-6dd13a704b40 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:12.665714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-610012a4-00e4-4205-b664-6dd13a704b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.666824 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a80d08-1f65-4377-85fc-015747f355c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.667503 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a80d08-1f65-4377-85fc-015747f355c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.667779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a80d08-1f65-4377-85fc-015747f355c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.668054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a80d08-1f65-4377-85fc-015747f355c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.669118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a80d08-1f65-4377-85fc-015747f355c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.670710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a80d08-1f65-4377-85fc-015747f355c9 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.683176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1118/2215] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:12.683176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66abc5-d63f-4c74-8da8-e07ec10a5aae None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.683176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66abc5-d63f-4c74-8da8-e07ec10a5aae None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.683685 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1098/2216] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:12.684493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66abc5-d63f-4c74-8da8-e07ec10a5aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.686942 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a80d08-1f65-4377-85fc-015747f355c9 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.688927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-16a80d08-1f65-4377-85fc-015747f355c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.712603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-cb66abc5-d63f-4c74-8da8-e07ec10a5aae None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:12.715254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cb66abc5-d63f-4c74-8da8-e07ec10a5aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.728600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1119/2217] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:12.731047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66abc5-d63f-4c74-8da8-e07ec10a5aae None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.747958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66abc5-d63f-4c74-8da8-e07ec10a5aae None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.755680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889cf20-bdff-4876-8ce7-146e1e395d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.756802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889cf20-bdff-4876-8ce7-146e1e395d98 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.757296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889cf20-bdff-4876-8ce7-146e1e395d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.757819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889cf20-bdff-4876-8ce7-146e1e395d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.758696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a80d08-1f65-4377-85fc-015747f355c9 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.759171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889cf20-bdff-4876-8ce7-146e1e395d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.762864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889cf20-bdff-4876-8ce7-146e1e395d98 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.763200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf0b90-87b4-4977-8f0a-ad6af0f2e777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.763860 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf0b90-87b4-4977-8f0a-ad6af0f2e777 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.764140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf0b90-87b4-4977-8f0a-ad6af0f2e777 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.764419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf0b90-87b4-4977-8f0a-ad6af0f2e777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.774754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf0b90-87b4-4977-8f0a-ad6af0f2e777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.777276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf0b90-87b4-4977-8f0a-ad6af0f2e777 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.785444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1120/2218] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:12.785444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889cf20-bdff-4876-8ce7-146e1e395d98 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.786572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4889cf20-bdff-4876-8ce7-146e1e395d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.789466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1099/2219] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:12.792478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabfa04-9b38-4858-b881-b59077b33a0f None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.793007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabfa04-9b38-4858-b881-b59077b33a0f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.793511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabfa04-9b38-4858-b881-b59077b33a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.809546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889cf20-bdff-4876-8ce7-146e1e395d98 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.816158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcee2f-2d51-423b-b3d3-eef6e00a58ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.817257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcee2f-2d51-423b-b3d3-eef6e00a58ed service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.817793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcee2f-2d51-423b-b3d3-eef6e00a58ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.818181 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-fcabfa04-9b38-4858-b881-b59077b33a0f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:12.818384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcee2f-2d51-423b-b3d3-eef6e00a58ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.819641 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-fcabfa04-9b38-4858-b881-b59077b33a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:12.829383 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1100/2220] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:12.833452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabfa04-9b38-4858-b881-b59077b33a0f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.836265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcee2f-2d51-423b-b3d3-eef6e00a58ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.838092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcee2f-2d51-423b-b3d3-eef6e00a58ed service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.844462 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabfa04-9b38-4858-b881-b59077b33a0f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.849481 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b22126-fab5-4e4c-9d38-990833fea388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.850440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b22126-fab5-4e4c-9d38-990833fea388 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.850718 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b22126-fab5-4e4c-9d38-990833fea388 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.850998 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b22126-fab5-4e4c-9d38-990833fea388 admin admin] PATH_INFO: `/v3/projects/3921037165464922bb64cd4fbea35ae0/users/00d5aeec35784bfb80b431605ef02a8b/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.854963 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1121/2221] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:12.862720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcee2f-2d51-423b-b3d3-eef6e00a58ed service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.874808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcee2f-2d51-423b-b3d3-eef6e00a58ed service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.880205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bfc73-7d67-4db2-a563-c85ff8878428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:12.881235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bfc73-7d67-4db2-a563-c85ff8878428 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.881235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bfc73-7d67-4db2-a563-c85ff8878428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.881524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bfc73-7d67-4db2-a563-c85ff8878428 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.881695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b22126-fab5-4e4c-9d38-990833fea388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3921037165464922bb64cd4fbea35ae0, user_id=00d5aeec35784bfb80b431605ef02a8b, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.882174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bfc73-7d67-4db2-a563-c85ff8878428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:12.882480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bfc73-7d67-4db2-a563-c85ff8878428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:12.884106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bfc73-7d67-4db2-a563-c85ff8878428 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.889951 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b22126-fab5-4e4c-9d38-990833fea388 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:12.901817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1122/2222] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:12.906786 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bfc73-7d67-4db2-a563-c85ff8878428 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:12.935317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bfc73-7d67-4db2-a563-c85ff8878428 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:12.944038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1101/2223] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:12 2022] PUT /identity/v3/projects/3921037165464922bb64cd4fbea35ae0/users/00d5aeec35784bfb80b431605ef02a8b/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:12.946647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfffcc-f836-47cf-94f7-b4fb09d25cec None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:12.947059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfffcc-f836-47cf-94f7-b4fb09d25cec None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:12.947561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfffcc-f836-47cf-94f7-b4fb09d25cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:12.972425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-fecfffcc-f836-47cf-94f7-b4fb09d25cec None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:12.974687 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-fecfffcc-f836-47cf-94f7-b4fb09d25cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:13.082177 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e0cdf-55ee-455e-b888-66ef7ad41885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:13.083425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e0cdf-55ee-455e-b888-66ef7ad41885 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:13.084011 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e0cdf-55ee-455e-b888-66ef7ad41885 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:13.084472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e0cdf-55ee-455e-b888-66ef7ad41885 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:13.085847 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e0cdf-55ee-455e-b888-66ef7ad41885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:13.091153 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1102/2224] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:13.091330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e0cdf-55ee-455e-b888-66ef7ad41885 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:13.116400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfffcc-f836-47cf-94f7-b4fb09d25cec None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:13.150507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1123/2225] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:12 2022] POST /identity/v3/projects => generated 383 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:13.156326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e0cdf-55ee-455e-b888-66ef7ad41885 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:13.234948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecfffcc-f836-47cf-94f7-b4fb09d25cec None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:13.258861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e0cdf-55ee-455e-b888-66ef7ad41885 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:13.275963 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117282ff-a245-4d97-9706-ae9e7c3f1250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:13.276860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117282ff-a245-4d97-9706-ae9e7c3f1250 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:13.277313 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117282ff-a245-4d97-9706-ae9e7c3f1250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:13.277794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117282ff-a245-4d97-9706-ae9e7c3f1250 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:13.278980 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117282ff-a245-4d97-9706-ae9e7c3f1250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:13.281618 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117282ff-a245-4d97-9706-ae9e7c3f1250 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:13.321788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1124/2226] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:13 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:13.323933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117282ff-a245-4d97-9706-ae9e7c3f1250 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:13.327342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ed6e3-e905-482e-904a-15c6d584a51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:13.328167 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed6e3-e905-482e-904a-15c6d584a51f service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:13.328598 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed6e3-e905-482e-904a-15c6d584a51f service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:13.328886 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ed6e3-e905-482e-904a-15c6d584a51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:13.340638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117282ff-a245-4d97-9706-ae9e7c3f1250 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:13.340958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ed6e3-e905-482e-904a-15c6d584a51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:13.342173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ed6e3-e905-482e-904a-15c6d584a51f service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:13.349197 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c17119-4965-491b-a712-b09f52974ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:13.350327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c17119-4965-491b-a712-b09f52974ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:13.350817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c17119-4965-491b-a712-b09f52974ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:13.351302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c17119-4965-491b-a712-b09f52974ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:13.352661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c17119-4965-491b-a712-b09f52974ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:13.355630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c17119-4965-491b-a712-b09f52974ba2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:13.355816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1103/2227] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:13.367838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1125/2228] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:13.373551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ed6e3-e905-482e-904a-15c6d584a51f service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:13.383650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ed6e3-e905-482e-904a-15c6d584a51f service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:13.389950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f680e-832b-4f5c-9eac-e678e35f9a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:13.389950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f680e-832b-4f5c-9eac-e678e35f9a11 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:13.390372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f680e-832b-4f5c-9eac-e678e35f9a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:13.390946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f680e-832b-4f5c-9eac-e678e35f9a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:13.391436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f680e-832b-4f5c-9eac-e678e35f9a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:13.393306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f680e-832b-4f5c-9eac-e678e35f9a11 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:13.404525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1104/2229] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:13.409075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c17119-4965-491b-a712-b09f52974ba2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:13.426509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c17119-4965-491b-a712-b09f52974ba2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:13.446703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012e353-b6d5-4e58-a279-4f52e43a0c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:13.451241 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012e353-b6d5-4e58-a279-4f52e43a0c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:13.451777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012e353-b6d5-4e58-a279-4f52e43a0c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:13.452244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012e353-b6d5-4e58-a279-4f52e43a0c78 admin admin] PATH_INFO: `/v3/projects/7ffbb51caa8f4c52aa04d25ee5717c11/users/bfe23cf513da4f4ea83ef5d116dc06ef/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:13.500914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012e353-b6d5-4e58-a279-4f52e43a0c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ffbb51caa8f4c52aa04d25ee5717c11, user_id=bfe23cf513da4f4ea83ef5d116dc06ef, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:13.505488 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012e353-b6d5-4e58-a279-4f52e43a0c78 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:13.530835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1126/2230] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:13 2022] PUT /identity/v3/projects/7ffbb51caa8f4c52aa04d25ee5717c11/users/bfe23cf513da4f4ea83ef5d116dc06ef/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:56:13.546798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda9144-a200-4d41-9463-40ee2d38f445 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:13.547736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda9144-a200-4d41-9463-40ee2d38f445 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:13.548277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda9144-a200-4d41-9463-40ee2d38f445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:13.594099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3fda9144-a200-4d41-9463-40ee2d38f445 None None] MFA Rules not processed for user `bfe23cf513da4f4ea83ef5d116dc06ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:13.595962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3fda9144-a200-4d41-9463-40ee2d38f445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:13.605927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012e353-b6d5-4e58-a279-4f52e43a0c78 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:13.608220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e012e353-b6d5-4e58-a279-4f52e43a0c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:13.736845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1105/2231] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:13.738922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda9144-a200-4d41-9463-40ee2d38f445 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:13.741835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3fda9144-a200-4d41-9463-40ee2d38f445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:13.749006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012e353-b6d5-4e58-a279-4f52e43a0c78 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:13.755759 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:13.758307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:13.758775 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:13.759241 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] PATH_INFO: `/v3/projects/32d8e09ab8fb4537b40df3a093dc7db6` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:13.761421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda9144-a200-4d41-9463-40ee2d38f445 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:13.761990 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d8e09ab8fb4537b40df3a093dc7db6)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:13.767672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:13.769707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:13.771220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:13.771905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:13.772166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] PATH_INFO: `/v3/projects/dc1f18440100494692144476cd4c9b0d` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:13.774227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1f18440100494692144476cd4c9b0d)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:13.778683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:13.856108 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d8e09ab8fb4537b40df3a093dc7db6', 'request_id': 'req-2a95bc8f-24e8-40f8-bb69-2731bbb82475'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:13.861207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1f18440100494692144476cd4c9b0d', 'request_id': 'req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:13.867288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d8e09ab8fb4537b40df3a093dc7db6', 'request_id': 'req-2a95bc8f-24e8-40f8-bb69-2731bbb82475'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:13.872238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1f18440100494692144476cd4c9b0d', 'request_id': 'req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:13.881016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d8e09ab8fb4537b40df3a093dc7db6', 'request_id': 'req-2a95bc8f-24e8-40f8-bb69-2731bbb82475'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:13.913612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1f18440100494692144476cd4c9b0d', 'request_id': 'req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:13.913901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] The token cache is being invalidate because project 32d8e09ab8fb4537b40df3a093dc7db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:13.913901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:13.913901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:13.918611 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] The token cache is being invalidate because project dc1f18440100494692144476cd4c9b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:13.919437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:13.923094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-cb84af5a-c3af-46a6-b01a-15f5ed7bb793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:13.923464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1127/2232] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:13 2022] DELETE /identity/v3/projects/32d8e09ab8fb4537b40df3a093dc7db6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:56:13.923464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:13.923669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1106/2233] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:13 2022] DELETE /identity/v3/projects/dc1f18440100494692144476cd4c9b0d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:13.925955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:13.927602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca2c7-335c-48aa-ac5c-ce40fbc72c48 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:13.928659 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca2c7-335c-48aa-ac5c-ce40fbc72c48 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:13.929540 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca2c7-335c-48aa-ac5c-ce40fbc72c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:13.958750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f43ca2c7-335c-48aa-ac5c-ce40fbc72c48 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:13.960289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f43ca2c7-335c-48aa-ac5c-ce40fbc72c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:14.090575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1107/2234] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:14.090575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca2c7-335c-48aa-ac5c-ce40fbc72c48 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:14.090575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f43ca2c7-335c-48aa-ac5c-ce40fbc72c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:14.098190 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca2c7-335c-48aa-ac5c-ce40fbc72c48 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:14.107663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:14.108684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:14.109122 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:14.109286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] PATH_INFO: `/v3/users/08254f48f41a4de8a1f90eb8c094d608` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:14.112194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08254f48f41a4de8a1f90eb8c094d608)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:14.114665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:14.132152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95bc8f-24e8-40f8-bb69-2731bbb82475 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:14.141114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacf5cf-4a6e-4e32-8751-e1d3b8bfc719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:14.142251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacf5cf-4a6e-4e32-8751-e1d3b8bfc719 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:14.142747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacf5cf-4a6e-4e32-8751-e1d3b8bfc719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:14.143214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacf5cf-4a6e-4e32-8751-e1d3b8bfc719 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:14.144881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacf5cf-4a6e-4e32-8751-e1d3b8bfc719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:14.149865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacf5cf-4a6e-4e32-8751-e1d3b8bfc719 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:14.188612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08254f48f41a4de8a1f90eb8c094d608'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:14.189555 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08254f48f41a4de8a1f90eb8c094d608'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:14.193400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08254f48f41a4de8a1f90eb8c094d608'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:14.205798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08254f48f41a4de8a1f90eb8c094d608'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:14.219544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1128/2235] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:13 2022] POST /identity/v3/projects => generated 383 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:14.221733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990970fa-f044-4047-b42a-4344dca81b76 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:14.222324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990970fa-f044-4047-b42a-4344dca81b76 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:14.222852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990970fa-f044-4047-b42a-4344dca81b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:14.232213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08254f48f41a4de8a1f90eb8c094d608'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:14.256882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-990970fa-f044-4047-b42a-4344dca81b76 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:14.258244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-990970fa-f044-4047-b42a-4344dca81b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:14.296327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1108/2236] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:14 2022] DELETE /identity/v3/users/08254f48f41a4de8a1f90eb8c094d608 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:14.302427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:14.304792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:14.464918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1129/2237] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:14.467589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990970fa-f044-4047-b42a-4344dca81b76 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:14.491024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990970fa-f044-4047-b42a-4344dca81b76 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:14.568956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c017dc6-d8f8-4a83-a05d-ce9701465b15 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:14.581194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6df6c-12f8-43bb-bb13-2fcf8e552126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:14.583377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6df6c-12f8-43bb-bb13-2fcf8e552126 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:14.583889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6df6c-12f8-43bb-bb13-2fcf8e552126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:14.584929 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6df6c-12f8-43bb-bb13-2fcf8e552126 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:14.586667 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6df6c-12f8-43bb-bb13-2fcf8e552126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:14.591879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6df6c-12f8-43bb-bb13-2fcf8e552126 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:14.648100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1109/2238] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:14 2022] POST /identity/v3/users => generated 298 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:14.654490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6df6c-12f8-43bb-bb13-2fcf8e552126 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:14.717053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6df6c-12f8-43bb-bb13-2fcf8e552126 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:14.731359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d4b8-54e5-4a5c-89cf-9448753558e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:14.733994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d4b8-54e5-4a5c-89cf-9448753558e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:14.734420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d4b8-54e5-4a5c-89cf-9448753558e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:14.734826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34d4b8-54e5-4a5c-89cf-9448753558e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:14.737340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34d4b8-54e5-4a5c-89cf-9448753558e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:14.737864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34d4b8-54e5-4a5c-89cf-9448753558e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:14.740631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34d4b8-54e5-4a5c-89cf-9448753558e6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:14.746377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c223875-c6b8-4d58-9a42-e3bdef455e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:14.747578 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c223875-c6b8-4d58-9a42-e3bdef455e0f admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:14.747931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c223875-c6b8-4d58-9a42-e3bdef455e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:14.748359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c223875-c6b8-4d58-9a42-e3bdef455e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:14.749729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c223875-c6b8-4d58-9a42-e3bdef455e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:14.753928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c223875-c6b8-4d58-9a42-e3bdef455e0f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:14.776404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1110/2239] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:56:14.783061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c223875-c6b8-4d58-9a42-e3bdef455e0f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:14.796380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1130/2240] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:14.798094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d4b8-54e5-4a5c-89cf-9448753558e6 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:14.814400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c223875-c6b8-4d58-9a42-e3bdef455e0f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:14.822790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34d4b8-54e5-4a5c-89cf-9448753558e6 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:14.836655 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf853e-dcd5-4d1a-af46-b600dfecda04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:14.839577 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf853e-dcd5-4d1a-af46-b600dfecda04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:14.840266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf853e-dcd5-4d1a-af46-b600dfecda04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:14.840879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf853e-dcd5-4d1a-af46-b600dfecda04 admin admin] PATH_INFO: `/v3/projects/a33bd0d4766748af8d7ef00faf472f7f/users/cc3f6a45c7324d01be1f044e242c8a39/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:14.849431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04047a-2046-47ca-a5c3-8030dd9f0f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:14.850583 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04047a-2046-47ca-a5c3-8030dd9f0f61 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:14.851412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04047a-2046-47ca-a5c3-8030dd9f0f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:14.852712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04047a-2046-47ca-a5c3-8030dd9f0f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:14.854669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04047a-2046-47ca-a5c3-8030dd9f0f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:14.859530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04047a-2046-47ca-a5c3-8030dd9f0f61 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:14.893923 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf853e-dcd5-4d1a-af46-b600dfecda04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33bd0d4766748af8d7ef00faf472f7f, user_id=cc3f6a45c7324d01be1f044e242c8a39, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:14.898992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf853e-dcd5-4d1a-af46-b600dfecda04 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:14.947835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1111/2241] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:14 2022] PUT /identity/v3/projects/a33bd0d4766748af8d7ef00faf472f7f/users/cc3f6a45c7324d01be1f044e242c8a39/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:14.954805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf853e-dcd5-4d1a-af46-b600dfecda04 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:15.004306 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1131/2242] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:14 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:56:15.012506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04047a-2046-47ca-a5c3-8030dd9f0f61 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:15.080934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf853e-dcd5-4d1a-af46-b600dfecda04 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:15.161989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d359297-b423-4654-8c66-112a5acee7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:15.162681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d359297-b423-4654-8c66-112a5acee7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.162964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d359297-b423-4654-8c66-112a5acee7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.163243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d359297-b423-4654-8c66-112a5acee7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.163988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d359297-b423-4654-8c66-112a5acee7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:15.165701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d359297-b423-4654-8c66-112a5acee7f7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:15.190983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1112/2243] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:56:15.190983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d359297-b423-4654-8c66-112a5acee7f7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:15.196242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4d359297-b423-4654-8c66-112a5acee7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:15.217261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d359297-b423-4654-8c66-112a5acee7f7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:15.223736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:15.225178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.225722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.226208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] PATH_INFO: `/v3/projects/cf07bf4006a4408a9d73afcda2ed3d3b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.229310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf07bf4006a4408a9d73afcda2ed3d3b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:15.231869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:15.293966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04047a-2046-47ca-a5c3-8030dd9f0f61 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:15.333637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d8fa5-a5a5-49c1-8e5d-942606593b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:15.335174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d8fa5-a5a5-49c1-8e5d-942606593b84 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.335964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d8fa5-a5a5-49c1-8e5d-942606593b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.336816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d8fa5-a5a5-49c1-8e5d-942606593b84 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.338778 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d8fa5-a5a5-49c1-8e5d-942606593b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:15.344197 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d8fa5-a5a5-49c1-8e5d-942606593b84 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:15.409308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf07bf4006a4408a9d73afcda2ed3d3b', 'request_id': 'req-09375dff-61bc-4d2b-bf29-dadbc18d86de'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:15.436820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1132/2244] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:15 2022] POST /identity/v3/users => generated 289 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:15.436820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d8fa5-a5a5-49c1-8e5d-942606593b84 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:15.438036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf07bf4006a4408a9d73afcda2ed3d3b', 'request_id': 'req-09375dff-61bc-4d2b-bf29-dadbc18d86de'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:15.472127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf07bf4006a4408a9d73afcda2ed3d3b', 'request_id': 'req-09375dff-61bc-4d2b-bf29-dadbc18d86de'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:15.489271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d8fa5-a5a5-49c1-8e5d-942606593b84 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:15.496730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] The token cache is being invalidate because project cf07bf4006a4408a9d73afcda2ed3d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:15.498787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:15.504433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:15.512975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1113/2245] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:15 2022] DELETE /identity/v3/projects/cf07bf4006a4408a9d73afcda2ed3d3b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:15.514482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:15.521508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:15.647944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdab80a-d94c-4bd2-a77a-08f79cad617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:15.649073 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab80a-d94c-4bd2-a77a-08f79cad617b admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.649458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab80a-d94c-4bd2-a77a-08f79cad617b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.649966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab80a-d94c-4bd2-a77a-08f79cad617b admin admin] PATH_INFO: `/v3/projects/a33bd0d4766748af8d7ef00faf472f7f/users/cc3f6a45c7324d01be1f044e242c8a39/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.652734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdab80a-d94c-4bd2-a77a-08f79cad617b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33bd0d4766748af8d7ef00faf472f7f, user_id=cc3f6a45c7324d01be1f044e242c8a39, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:15.656226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdab80a-d94c-4bd2-a77a-08f79cad617b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:15.673628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1133/2246] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:15 2022] PUT /identity/v3/projects/a33bd0d4766748af8d7ef00faf472f7f/users/cc3f6a45c7324d01be1f044e242c8a39/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:15.673628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312947e-f17a-4a7c-8614-250c456e3d7d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.673628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312947e-f17a-4a7c-8614-250c456e3d7d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.673628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312947e-f17a-4a7c-8614-250c456e3d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.689645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09375dff-61bc-4d2b-bf29-dadbc18d86de admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:15.708811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e312947e-f17a-4a7c-8614-250c456e3d7d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:15.713384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e312947e-f17a-4a7c-8614-250c456e3d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:15.792599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d2a55-4172-491e-830f-034660e60833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:15.793419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2a55-4172-491e-830f-034660e60833 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.794029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2a55-4172-491e-830f-034660e60833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.794317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d2a55-4172-491e-830f-034660e60833 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.797062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d2a55-4172-491e-830f-034660e60833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:15.799026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d2a55-4172-491e-830f-034660e60833 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:15.815902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1114/2247] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:15.817033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b8701-a2de-460f-8bec-7ce4edc23f73 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.817326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b8701-a2de-460f-8bec-7ce4edc23f73 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.817615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b8701-a2de-460f-8bec-7ce4edc23f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.849765 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-192b8701-a2de-460f-8bec-7ce4edc23f73 None None] MFA Rules not processed for user `cc3f6a45c7324d01be1f044e242c8a39`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:15.850846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-192b8701-a2de-460f-8bec-7ce4edc23f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:15.860999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1134/2248] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:15.860999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312947e-f17a-4a7c-8614-250c456e3d7d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:15.869362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312947e-f17a-4a7c-8614-250c456e3d7d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:15.874697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbca4b-cee8-4b84-af92-fa5209d3c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:15.875383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbca4b-cee8-4b84-af92-fa5209d3c5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.875652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbca4b-cee8-4b84-af92-fa5209d3c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.875928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbca4b-cee8-4b84-af92-fa5209d3c5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.876795 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbca4b-cee8-4b84-af92-fa5209d3c5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:15.878502 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbca4b-cee8-4b84-af92-fa5209d3c5b0 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:15.895911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1135/2249] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:15.898208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88085980-28ee-4a30-96ab-7793e782cdf3 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.898558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88085980-28ee-4a30-96ab-7793e782cdf3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.898888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88085980-28ee-4a30-96ab-7793e782cdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.926948 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-88085980-28ee-4a30-96ab-7793e782cdf3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:15.928374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-88085980-28ee-4a30-96ab-7793e782cdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:15.937049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1136/2250] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:15.938007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88085980-28ee-4a30-96ab-7793e782cdf3 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:15.949870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88085980-28ee-4a30-96ab-7793e782cdf3 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:15.954996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1115/2251] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:15.956538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b8701-a2de-460f-8bec-7ce4edc23f73 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:15.961554 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee03ee-b6fb-4160-843a-ced2d2bd27b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:15.962345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee03ee-b6fb-4160-843a-ced2d2bd27b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.962815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee03ee-b6fb-4160-843a-ced2d2bd27b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.963162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee03ee-b6fb-4160-843a-ced2d2bd27b8 admin admin] PATH_INFO: `/v3/projects/6906900165724dd285750b2a09b92b66/users/ef623fa30c4647e18d9dd3f81704e0ab/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.984692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee03ee-b6fb-4160-843a-ced2d2bd27b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6906900165724dd285750b2a09b92b66, user_id=ef623fa30c4647e18d9dd3f81704e0ab, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:15.985984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b8701-a2de-460f-8bec-7ce4edc23f73 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:15.988150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee03ee-b6fb-4160-843a-ced2d2bd27b8 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:15.993915 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5a2d5-94eb-4cc8-a138-f36c815d5950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:15.995718 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5a2d5-94eb-4cc8-a138-f36c815d5950 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:15.996988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5a2d5-94eb-4cc8-a138-f36c815d5950 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:15.997716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5a2d5-94eb-4cc8-a138-f36c815d5950 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:15.998745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5a2d5-94eb-4cc8-a138-f36c815d5950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:16.000475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5a2d5-94eb-4cc8-a138-f36c815d5950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:16.002911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5a2d5-94eb-4cc8-a138-f36c815d5950 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:16.013226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1137/2252] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:15 2022] PUT /identity/v3/projects/6906900165724dd285750b2a09b92b66/users/ef623fa30c4647e18d9dd3f81704e0ab/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:16.015223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee03ee-b6fb-4160-843a-ced2d2bd27b8 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:16.018018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-dbee03ee-b6fb-4160-843a-ced2d2bd27b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:16.024623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1116/2253] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:16.026663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d8a90-ebb9-47be-bf70-51a86d65d7d7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:16.027110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d8a90-ebb9-47be-bf70-51a86d65d7d7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:16.027592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d8a90-ebb9-47be-bf70-51a86d65d7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:16.050682 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c15d8a90-ebb9-47be-bf70-51a86d65d7d7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:16.052346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c15d8a90-ebb9-47be-bf70-51a86d65d7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:16.095348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee03ee-b6fb-4160-843a-ced2d2bd27b8 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:16.100157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e94943-f989-47cf-948d-f268babe7f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:16.101172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94943-f989-47cf-948d-f268babe7f4b service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:16.101681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94943-f989-47cf-948d-f268babe7f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:16.102024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94943-f989-47cf-948d-f268babe7f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:16.127730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1117/2254] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:16.129038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d8a90-ebb9-47be-bf70-51a86d65d7d7 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:16.141889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d8a90-ebb9-47be-bf70-51a86d65d7d7 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:16.147684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28176254-b466-4b2d-bb54-530ea078182d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:16.148551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176254-b466-4b2d-bb54-530ea078182d admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:16.148949 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176254-b466-4b2d-bb54-530ea078182d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:16.149379 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28176254-b466-4b2d-bb54-530ea078182d admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:16.150143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28176254-b466-4b2d-bb54-530ea078182d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:16.152523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28176254-b466-4b2d-bb54-530ea078182d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:16.186015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1118/2255] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:16 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:16.186342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e94943-f989-47cf-948d-f268babe7f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:16.188729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e94943-f989-47cf-948d-f268babe7f4b service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:16.190858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28176254-b466-4b2d-bb54-530ea078182d admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:16.192684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-28176254-b466-4b2d-bb54-530ea078182d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:16.204982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1138/2256] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:16.205884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e94943-f989-47cf-948d-f268babe7f4b service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:16.217133 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e94943-f989-47cf-948d-f268babe7f4b service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:16.272787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28176254-b466-4b2d-bb54-530ea078182d admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:16.277768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31afab5-20f5-43d3-a23b-b9db6a0573bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:16.278580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31afab5-20f5-43d3-a23b-b9db6a0573bb service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:16.278928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31afab5-20f5-43d3-a23b-b9db6a0573bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:16.279348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31afab5-20f5-43d3-a23b-b9db6a0573bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:16.359800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b139cd-0bc6-4af3-8a60-b7b5cbe81332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:16.361209 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b139cd-0bc6-4af3-8a60-b7b5cbe81332 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:16.361692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b139cd-0bc6-4af3-8a60-b7b5cbe81332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:16.362234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b139cd-0bc6-4af3-8a60-b7b5cbe81332 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:16.363092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b139cd-0bc6-4af3-8a60-b7b5cbe81332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:16.364480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31afab5-20f5-43d3-a23b-b9db6a0573bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:16.366519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31afab5-20f5-43d3-a23b-b9db6a0573bb service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:16.372212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b139cd-0bc6-4af3-8a60-b7b5cbe81332 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:16.378045 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1119/2257] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:16.379195 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31afab5-20f5-43d3-a23b-b9db6a0573bb service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:16.424464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1139/2258] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:16 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:16.425679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b139cd-0bc6-4af3-8a60-b7b5cbe81332 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:16.437990 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b139cd-0bc6-4af3-8a60-b7b5cbe81332 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:16.446239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86dca5-cef2-41b9-81ff-4bdb66f2895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:16.447139 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86dca5-cef2-41b9-81ff-4bdb66f2895d admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:16.448294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86dca5-cef2-41b9-81ff-4bdb66f2895d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:16.448294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86dca5-cef2-41b9-81ff-4bdb66f2895d admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:16.449345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86dca5-cef2-41b9-81ff-4bdb66f2895d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:16.451344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86dca5-cef2-41b9-81ff-4bdb66f2895d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:16.473836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1140/2259] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:16.474887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86dca5-cef2-41b9-81ff-4bdb66f2895d admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:16.486744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86dca5-cef2-41b9-81ff-4bdb66f2895d admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:16.493696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ccf66-7a0a-45d8-b30f-5ac46df2a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:16.494977 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ccf66-7a0a-45d8-b30f-5ac46df2a5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:16.495588 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ccf66-7a0a-45d8-b30f-5ac46df2a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:16.495726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ccf66-7a0a-45d8-b30f-5ac46df2a5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:16.496869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ccf66-7a0a-45d8-b30f-5ac46df2a5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:16.499341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31afab5-20f5-43d3-a23b-b9db6a0573bb service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:16.499532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19ccf66-7a0a-45d8-b30f-5ac46df2a5a7 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:16.509723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46004644-7354-40d7-bf4e-74ebe46009ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:16.511762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46004644-7354-40d7-bf4e-74ebe46009ec service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:16.513446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46004644-7354-40d7-bf4e-74ebe46009ec service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:16.514417 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46004644-7354-40d7-bf4e-74ebe46009ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:16.518934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-46004644-7354-40d7-bf4e-74ebe46009ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:16.523159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1141/2260] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:16.530881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ccf66-7a0a-45d8-b30f-5ac46df2a5a7 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:16.553018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ccf66-7a0a-45d8-b30f-5ac46df2a5a7 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:16.565491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3dc29-6380-455b-aff0-e76cc762138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:16.566530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3dc29-6380-455b-aff0-e76cc762138a admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:16.566891 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3dc29-6380-455b-aff0-e76cc762138a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:16.567239 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3dc29-6380-455b-aff0-e76cc762138a admin admin] PATH_INFO: `/v3/projects/e6fe8489397f4142954f3bd45f73cc80/users/64eb50bb707e4fcfa5b940dc47538251/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:16.591246 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3dc29-6380-455b-aff0-e76cc762138a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fe8489397f4142954f3bd45f73cc80, user_id=64eb50bb707e4fcfa5b940dc47538251, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:16.597430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3dc29-6380-455b-aff0-e76cc762138a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:16.627939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1142/2261] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:16 2022] PUT /identity/v3/projects/e6fe8489397f4142954f3bd45f73cc80/users/64eb50bb707e4fcfa5b940dc47538251/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:16.639057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905cd7d-93a3-4f00-87df-d2e13b53910c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:16.639440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905cd7d-93a3-4f00-87df-d2e13b53910c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:16.639791 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905cd7d-93a3-4f00-87df-d2e13b53910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:16.701152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46004644-7354-40d7-bf4e-74ebe46009ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:16.701747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d905cd7d-93a3-4f00-87df-d2e13b53910c None None] MFA Rules not processed for user `64eb50bb707e4fcfa5b940dc47538251`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:16.704074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d905cd7d-93a3-4f00-87df-d2e13b53910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:16.705525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46004644-7354-40d7-bf4e-74ebe46009ec service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:16.730871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1120/2262] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:16.900348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1143/2263] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:16.902159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46004644-7354-40d7-bf4e-74ebe46009ec service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:16.926140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46004644-7354-40d7-bf4e-74ebe46009ec service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:17.236314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235fa83-4cdc-4c26-9d6a-a6bff389014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:17.237852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235fa83-4cdc-4c26-9d6a-a6bff389014f admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:17.238174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235fa83-4cdc-4c26-9d6a-a6bff389014f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:17.238457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235fa83-4cdc-4c26-9d6a-a6bff389014f admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:17.239176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235fa83-4cdc-4c26-9d6a-a6bff389014f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:17.247544 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4235fa83-4cdc-4c26-9d6a-a6bff389014f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:17.359158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1121/2264] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:16 2022] POST /identity/v3/projects => generated 383 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:17.360304 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905cd7d-93a3-4f00-87df-d2e13b53910c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:17.379687 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905cd7d-93a3-4f00-87df-d2e13b53910c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:17.414896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235fa83-4cdc-4c26-9d6a-a6bff389014f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:17.418042 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4235fa83-4cdc-4c26-9d6a-a6bff389014f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:17.587671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cb0eb-dec8-42c7-82f1-87dd0cd15f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:17.588829 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb0eb-dec8-42c7-82f1-87dd0cd15f1d admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:17.589119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb0eb-dec8-42c7-82f1-87dd0cd15f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:17.589391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb0eb-dec8-42c7-82f1-87dd0cd15f1d admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:17.593145 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cb0eb-dec8-42c7-82f1-87dd0cd15f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:17.595347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cb0eb-dec8-42c7-82f1-87dd0cd15f1d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:17.599910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235fa83-4cdc-4c26-9d6a-a6bff389014f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:17.616077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:17.617554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:17.618305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:17.618683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] PATH_INFO: `/v3/users/bfe23cf513da4f4ea83ef5d116dc06ef` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:17.621588 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe23cf513da4f4ea83ef5d116dc06ef)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:17.627225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:17.643297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1144/2265] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:17 2022] POST /identity/v3/users => generated 298 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:17.648220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cb0eb-dec8-42c7-82f1-87dd0cd15f1d admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:17.662598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cb0eb-dec8-42c7-82f1-87dd0cd15f1d admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:17.675646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e01c8d-dc18-4f9b-9360-86ed4df6bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:17.678901 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01c8d-dc18-4f9b-9360-86ed4df6bc39 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:17.679181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01c8d-dc18-4f9b-9360-86ed4df6bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:17.679454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e01c8d-dc18-4f9b-9360-86ed4df6bc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:17.682813 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e01c8d-dc18-4f9b-9360-86ed4df6bc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:17.687252 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e01c8d-dc18-4f9b-9360-86ed4df6bc39 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:17.714836 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1145/2266] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:56:17.723493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e01c8d-dc18-4f9b-9360-86ed4df6bc39 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:17.758540 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe23cf513da4f4ea83ef5d116dc06ef'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:17.759373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe23cf513da4f4ea83ef5d116dc06ef'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:17.763915 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe23cf513da4f4ea83ef5d116dc06ef'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:17.767276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e01c8d-dc18-4f9b-9360-86ed4df6bc39 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:17.777439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb5f7d-4094-4240-9b50-f86ecbbb53d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:17.778401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb5f7d-4094-4240-9b50-f86ecbbb53d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:17.778683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb5f7d-4094-4240-9b50-f86ecbbb53d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:17.778956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bb5f7d-4094-4240-9b50-f86ecbbb53d9 admin admin] PATH_INFO: `/v3/projects/5db74a9c269d4ef686f7455e7516c12e/users/98f70d4e57da4fe883b646f382729774/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:17.784175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe23cf513da4f4ea83ef5d116dc06ef'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:17.809504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb5f7d-4094-4240-9b50-f86ecbbb53d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db74a9c269d4ef686f7455e7516c12e, user_id=98f70d4e57da4fe883b646f382729774, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:17.810224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-a7cc8a83-a84b-4fca-80ed-43cb08e5c839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe23cf513da4f4ea83ef5d116dc06ef'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:17.814278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bb5f7d-4094-4240-9b50-f86ecbbb53d9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:17.843627 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1122/2267] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:17 2022] DELETE /identity/v3/users/bfe23cf513da4f4ea83ef5d116dc06ef => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:17.857841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73177f-a634-4ab3-bd20-a68826c3db0f None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:17.857841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73177f-a634-4ab3-bd20-a68826c3db0f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:17.857841 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73177f-a634-4ab3-bd20-a68826c3db0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:17.859689 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1146/2268] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:17 2022] PUT /identity/v3/projects/5db74a9c269d4ef686f7455e7516c12e/users/98f70d4e57da4fe883b646f382729774/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:17.874855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb5f7d-4094-4240-9b50-f86ecbbb53d9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:17.878864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c7bb5f7d-4094-4240-9b50-f86ecbbb53d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:17.905201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-fb73177f-a634-4ab3-bd20-a68826c3db0f None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:17.907696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-fb73177f-a634-4ab3-bd20-a68826c3db0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:18.010876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1123/2269] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:18.028009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73177f-a634-4ab3-bd20-a68826c3db0f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:18.029516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-fb73177f-a634-4ab3-bd20-a68826c3db0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:18.059087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bb5f7d-4094-4240-9b50-f86ecbbb53d9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:18.069708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e51e-be50-41c8-83ca-0ad2639692eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:18.070330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e51e-be50-41c8-83ca-0ad2639692eb admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:18.071415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e51e-be50-41c8-83ca-0ad2639692eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:18.071549 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e51e-be50-41c8-83ca-0ad2639692eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:18.073279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964e51e-be50-41c8-83ca-0ad2639692eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:18.075452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964e51e-be50-41c8-83ca-0ad2639692eb admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:18.108683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1147/2270] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:18.111473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e51e-be50-41c8-83ca-0ad2639692eb admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:18.124459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e51e-be50-41c8-83ca-0ad2639692eb admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:18.134454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea823e1a-17c8-4ed5-8e00-62201b918b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:18.135575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea823e1a-17c8-4ed5-8e00-62201b918b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:18.135915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea823e1a-17c8-4ed5-8e00-62201b918b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:18.136200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea823e1a-17c8-4ed5-8e00-62201b918b18 admin admin] PATH_INFO: `/v3/projects/5db74a9c269d4ef686f7455e7516c12e/users/98f70d4e57da4fe883b646f382729774/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:18.138209 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73177f-a634-4ab3-bd20-a68826c3db0f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:18.138643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea823e1a-17c8-4ed5-8e00-62201b918b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db74a9c269d4ef686f7455e7516c12e, user_id=98f70d4e57da4fe883b646f382729774, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:18.143045 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ff7f9-fe80-4add-acc9-bd764eed4660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:18.144011 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea823e1a-17c8-4ed5-8e00-62201b918b18 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:18.144401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ff7f9-fe80-4add-acc9-bd764eed4660 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:18.144938 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ff7f9-fe80-4add-acc9-bd764eed4660 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:18.145413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ff7f9-fe80-4add-acc9-bd764eed4660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:18.156679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1148/2271] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:18 2022] PUT /identity/v3/projects/5db74a9c269d4ef686f7455e7516c12e/users/98f70d4e57da4fe883b646f382729774/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:18.161863 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ff7f9-fe80-4add-acc9-bd764eed4660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:18.164796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ff7f9-fe80-4add-acc9-bd764eed4660 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:18.170594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f788-ec9f-4008-9495-f007fb51313c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:18.170894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f788-ec9f-4008-9495-f007fb51313c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:18.171246 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62f788-ec9f-4008-9495-f007fb51313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:18.186039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1124/2272] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:18.198028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ff7f9-fe80-4add-acc9-bd764eed4660 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:18.205936 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-cc1ff7f9-fe80-4add-acc9-bd764eed4660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:18.242505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ff7f9-fe80-4add-acc9-bd764eed4660 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:18.252119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-7c62f788-ec9f-4008-9495-f007fb51313c None None] MFA Rules not processed for user `98f70d4e57da4fe883b646f382729774`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:18.253388 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7c62f788-ec9f-4008-9495-f007fb51313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:18.359909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:18.359909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:18.359909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:18.360526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] PATH_INFO: `/v3/users/424eb9eb1c354a46bfc21f720e26a199` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:18.362384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=424eb9eb1c354a46bfc21f720e26a199)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:18.364490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:18.455384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '424eb9eb1c354a46bfc21f720e26a199'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:18.456568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '424eb9eb1c354a46bfc21f720e26a199'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:18.457446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '424eb9eb1c354a46bfc21f720e26a199'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:18.469497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '424eb9eb1c354a46bfc21f720e26a199'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:18.485026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3b2dbd90-97cd-40b2-b381-d04c10a57033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '424eb9eb1c354a46bfc21f720e26a199'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:18.487054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1149/2273] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:18.499226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f788-ec9f-4008-9495-f007fb51313c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:18.500818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7c62f788-ec9f-4008-9495-f007fb51313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:18.503392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1125/2274] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:18 2022] DELETE /identity/v3/users/424eb9eb1c354a46bfc21f720e26a199 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:18.507721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d75ee-699f-45a0-8344-ce5f47ee4d60 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:18.508190 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d75ee-699f-45a0-8344-ce5f47ee4d60 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:18.508691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d75ee-699f-45a0-8344-ce5f47ee4d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:18.544733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-af4d75ee-699f-45a0-8344-ce5f47ee4d60 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:18.547325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-af4d75ee-699f-45a0-8344-ce5f47ee4d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:18.649013 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62f788-ec9f-4008-9495-f007fb51313c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:18.687814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1126/2275] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:18.702469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d75ee-699f-45a0-8344-ce5f47ee4d60 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:18.704744 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-af4d75ee-699f-45a0-8344-ce5f47ee4d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:18.784340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc022-d641-4b3a-9412-0e7260e9ae59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:18.785025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc022-d641-4b3a-9412-0e7260e9ae59 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:18.785310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc022-d641-4b3a-9412-0e7260e9ae59 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:18.785661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc022-d641-4b3a-9412-0e7260e9ae59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:18.789033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0dddc022-d641-4b3a-9412-0e7260e9ae59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:18.834074 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d75ee-699f-45a0-8344-ce5f47ee4d60 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:18.844486 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacad2b-72fc-4765-b4f7-cea346039c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:18.845149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacad2b-72fc-4765-b4f7-cea346039c1e service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:18.845447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacad2b-72fc-4765-b4f7-cea346039c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:18.846628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacad2b-72fc-4765-b4f7-cea346039c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:18.883871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacad2b-72fc-4765-b4f7-cea346039c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:18.889179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacad2b-72fc-4765-b4f7-cea346039c1e service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:18.917272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1127/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:18.920121 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacad2b-72fc-4765-b4f7-cea346039c1e service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:18.920743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc022-d641-4b3a-9412-0e7260e9ae59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:18.922885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc022-d641-4b3a-9412-0e7260e9ae59 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:18.924007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9cacad2b-72fc-4765-b4f7-cea346039c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:18.960415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacad2b-72fc-4765-b4f7-cea346039c1e service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:18.961193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1150/2277] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:18.966448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc022-d641-4b3a-9412-0e7260e9ae59 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:18.972895 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0dddc022-d641-4b3a-9412-0e7260e9ae59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:18.973189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:18.974291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:18.974415 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:18.974667 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] PATH_INFO: `/v3/users/05c92531c5cd4593b81d3e7270a655be` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:18.977321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c92531c5cd4593b81d3e7270a655be)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:18.980017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:19.022465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc022-d641-4b3a-9412-0e7260e9ae59 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:19.036802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:19.037728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:19.038014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:19.038286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] PATH_INFO: `/v3/projects/7ffbb51caa8f4c52aa04d25ee5717c11` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:19.039550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ffbb51caa8f4c52aa04d25ee5717c11)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:19.042339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:19.085657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c92531c5cd4593b81d3e7270a655be'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.086376 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c92531c5cd4593b81d3e7270a655be'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.087757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c92531c5cd4593b81d3e7270a655be'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.104732 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c92531c5cd4593b81d3e7270a655be'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.129612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ae101bb5-c474-4b99-aae7-bdf3b482546a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c92531c5cd4593b81d3e7270a655be'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.166672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ffbb51caa8f4c52aa04d25ee5717c11', 'request_id': 'req-50eb45c5-1ff2-4f23-af04-acbed4026043'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.166811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1128/2278] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:18 2022] DELETE /identity/v3/users/05c92531c5cd4593b81d3e7270a655be => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:19.172754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57f89b-0a82-418f-8402-6eda5cd229ca None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:19.173202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57f89b-0a82-418f-8402-6eda5cd229ca None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:19.173490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57f89b-0a82-418f-8402-6eda5cd229ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:19.180713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ffbb51caa8f4c52aa04d25ee5717c11', 'request_id': 'req-50eb45c5-1ff2-4f23-af04-acbed4026043'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.200177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-4d57f89b-0a82-418f-8402-6eda5cd229ca None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:19.200731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ffbb51caa8f4c52aa04d25ee5717c11', 'request_id': 'req-50eb45c5-1ff2-4f23-af04-acbed4026043'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.201912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4d57f89b-0a82-418f-8402-6eda5cd229ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:19.218790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] The token cache is being invalidate because project 7ffbb51caa8f4c52aa04d25ee5717c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:19.219440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.222430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.225879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1151/2279] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:18 2022] DELETE /identity/v3/projects/7ffbb51caa8f4c52aa04d25ee5717c11 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:19.232024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:19.237960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:19.305248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1129/2280] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:19.354060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb45c5-1ff2-4f23-af04-acbed4026043 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:19.360163 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:19.360826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:19.361112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:19.361388 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] PATH_INFO: `/v3/users/cc3f6a45c7324d01be1f044e242c8a39` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:19.362725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3f6a45c7324d01be1f044e242c8a39)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:19.364741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:19.425769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57f89b-0a82-418f-8402-6eda5cd229ca None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:19.428056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4d57f89b-0a82-418f-8402-6eda5cd229ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:19.435817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3f6a45c7324d01be1f044e242c8a39'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.437886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3f6a45c7324d01be1f044e242c8a39'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.441082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3f6a45c7324d01be1f044e242c8a39'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.471377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3f6a45c7324d01be1f044e242c8a39'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.495945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3f6a45c7324d01be1f044e242c8a39'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:19.515350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1152/2281] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:19 2022] DELETE /identity/v3/users/cc3f6a45c7324d01be1f044e242c8a39 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:19.669933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57f89b-0a82-418f-8402-6eda5cd229ca None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:19.834089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ce39e-c220-4129-aac9-376cdfcab589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:19.838192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ce39e-c220-4129-aac9-376cdfcab589 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:19.838657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ce39e-c220-4129-aac9-376cdfcab589 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:19.838952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ce39e-c220-4129-aac9-376cdfcab589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:19.843278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b97ce39e-c220-4129-aac9-376cdfcab589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:20.004654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ce39e-c220-4129-aac9-376cdfcab589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:20.006205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ce39e-c220-4129-aac9-376cdfcab589 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:20.031810 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1130/2282] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:20.855473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:20.857157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:20.881630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7056af-a4fa-4ae1-a529-8d3d4cc5aad5 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:20.896569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:20.897692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:20.897787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:20.898019 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] PATH_INFO: `/v3/projects/350266a82c7e42dda9770fe6873f7554` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:20.899289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350266a82c7e42dda9770fe6873f7554)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:20.901898 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:21.015193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350266a82c7e42dda9770fe6873f7554', 'request_id': 'req-15fc4188-22fb-4aeb-bed0-5b042a6bee01'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.022399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350266a82c7e42dda9770fe6873f7554', 'request_id': 'req-15fc4188-22fb-4aeb-bed0-5b042a6bee01'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.042891 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350266a82c7e42dda9770fe6873f7554', 'request_id': 'req-15fc4188-22fb-4aeb-bed0-5b042a6bee01'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.060487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] The token cache is being invalidate because project 350266a82c7e42dda9770fe6873f7554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:21.060788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.061972 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.064365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1153/2283] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:20 2022] DELETE /identity/v3/projects/350266a82c7e42dda9770fe6873f7554 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:21.069864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae8e9-96c0-4649-a6af-5341426c50d1 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:21.070775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae8e9-96c0-4649-a6af-5341426c50d1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:21.071197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae8e9-96c0-4649-a6af-5341426c50d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:21.106297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-5feae8e9-96c0-4649-a6af-5341426c50d1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:21.113931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-5feae8e9-96c0-4649-a6af-5341426c50d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:21.158695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:21.160970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:21.287809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc4188-22fb-4aeb-bed0-5b042a6bee01 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:21.295940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:21.299055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:21.300060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:21.301089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] PATH_INFO: `/v3/projects/a33bd0d4766748af8d7ef00faf472f7f` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:21.303870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33bd0d4766748af8d7ef00faf472f7f)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:21.306067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:21.378498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33bd0d4766748af8d7ef00faf472f7f', 'request_id': 'req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.379177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1131/2284] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:21.388349 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9349d-1eb2-4cc6-a6d1-6d52ff1fbe5e None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:21.388778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9349d-1eb2-4cc6-a6d1-6d52ff1fbe5e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:21.389162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9349d-1eb2-4cc6-a6d1-6d52ff1fbe5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:21.395297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33bd0d4766748af8d7ef00faf472f7f', 'request_id': 'req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.422437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33bd0d4766748af8d7ef00faf472f7f', 'request_id': 'req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.442848 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-64b9349d-1eb2-4cc6-a6d1-6d52ff1fbe5e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:21.444380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-64b9349d-1eb2-4cc6-a6d1-6d52ff1fbe5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:21.465717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] The token cache is being invalidate because project a33bd0d4766748af8d7ef00faf472f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:21.466225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.467429 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.487351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1154/2285] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:21 2022] DELETE /identity/v3/projects/a33bd0d4766748af8d7ef00faf472f7f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:21.487351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:21.492523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:21.613839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1132/2286] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:21.618576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab346694-f6a7-49e1-b71e-e50697520d86 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:21.621062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab346694-f6a7-49e1-b71e-e50697520d86 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:21.621426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab346694-f6a7-49e1-b71e-e50697520d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:21.676026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-ab346694-f6a7-49e1-b71e-e50697520d86 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:21.677613 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ab346694-f6a7-49e1-b71e-e50697520d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:21.689756 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4537e46-a3ac-4f6c-af7f-5fdc644e77ba admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:21.706101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1133/2287] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:21.707947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab346694-f6a7-49e1-b71e-e50697520d86 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:21.708624 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:21.711206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:21.714738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:21.714738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] PATH_INFO: `/v3/projects/26b233b125434f1a942f9602bdc2a4e5` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:21.721825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b233b125434f1a942f9602bdc2a4e5)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:21.724505 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:21.743715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab346694-f6a7-49e1-b71e-e50697520d86 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:21.755658 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f805ab-896c-4d03-a789-418a4d8d489d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:21.756975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f805ab-896c-4d03-a789-418a4d8d489d admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:21.758945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f805ab-896c-4d03-a789-418a4d8d489d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:21.759481 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f805ab-896c-4d03-a789-418a4d8d489d admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:21.760495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f805ab-896c-4d03-a789-418a4d8d489d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:21.770102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f805ab-896c-4d03-a789-418a4d8d489d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:21.771999 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f805ab-896c-4d03-a789-418a4d8d489d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:21.789510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1134/2288] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:21.790719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6235fe-065a-49ae-a276-087ad4b96886 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:21.791952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6235fe-065a-49ae-a276-087ad4b96886 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:21.792238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6235fe-065a-49ae-a276-087ad4b96886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:21.834703 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-8d6235fe-065a-49ae-a276-087ad4b96886 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:21.838701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8d6235fe-065a-49ae-a276-087ad4b96886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:21.851283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b233b125434f1a942f9602bdc2a4e5', 'request_id': 'req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.862263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b233b125434f1a942f9602bdc2a4e5', 'request_id': 'req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.881192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b233b125434f1a942f9602bdc2a4e5', 'request_id': 'req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.906817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] The token cache is being invalidate because project 26b233b125434f1a942f9602bdc2a4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:21.909158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.910110 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:21.914718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1155/2289] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:21 2022] DELETE /identity/v3/projects/26b233b125434f1a942f9602bdc2a4e5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:21.914718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:21.919960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:21.965652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1135/2290] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:21.965652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6235fe-065a-49ae-a276-087ad4b96886 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:21.974251 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8d6235fe-065a-49ae-a276-087ad4b96886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:22.036437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52e3bf-39d6-49fb-9c25-c1d8eef6f246 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:22.038949 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6235fe-065a-49ae-a276-087ad4b96886 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:22.044327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf25b95-d014-4716-941c-b60b9cbca173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:22.045269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25b95-d014-4716-941c-b60b9cbca173 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:22.045729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25b95-d014-4716-941c-b60b9cbca173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:22.046335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25b95-d014-4716-941c-b60b9cbca173 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:22.054029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf25b95-d014-4716-941c-b60b9cbca173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:22.056583 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf25b95-d014-4716-941c-b60b9cbca173 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:22.062431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:22.063597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:22.067508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:22.068035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] PATH_INFO: `/v3/users/d743b85c9e554d93b9bc8ab528e0769a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:22.075049 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d743b85c9e554d93b9bc8ab528e0769a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:22.078711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:22.110018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1156/2291] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:21 2022] POST /identity/v3/projects => generated 397 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:22.111080 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf25b95-d014-4716-941c-b60b9cbca173 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:22.218758 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd743b85c9e554d93b9bc8ab528e0769a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:22.219584 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd743b85c9e554d93b9bc8ab528e0769a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:22.220220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd743b85c9e554d93b9bc8ab528e0769a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:22.237721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd743b85c9e554d93b9bc8ab528e0769a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:22.257483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf25b95-d014-4716-941c-b60b9cbca173 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:22.264756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd743b85c9e554d93b9bc8ab528e0769a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:22.269094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e50954-69c3-42f8-a8ff-f6d199f67093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:22.271134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e50954-69c3-42f8-a8ff-f6d199f67093 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:22.271433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e50954-69c3-42f8-a8ff-f6d199f67093 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:22.271716 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e50954-69c3-42f8-a8ff-f6d199f67093 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:22.274339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e50954-69c3-42f8-a8ff-f6d199f67093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:22.274924 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e50954-69c3-42f8-a8ff-f6d199f67093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:22.277715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e50954-69c3-42f8-a8ff-f6d199f67093 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:22.295690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1136/2292] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:21 2022] DELETE /identity/v3/users/d743b85c9e554d93b9bc8ab528e0769a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:22.298869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:22.298979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:22.311798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1157/2293] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:22.316438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e50954-69c3-42f8-a8ff-f6d199f67093 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:22.320933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b7e50954-69c3-42f8-a8ff-f6d199f67093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:22.353940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e50954-69c3-42f8-a8ff-f6d199f67093 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:22.521138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6065642-3630-4ba2-8a04-020184f528e7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:22.533752 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d7d83-7b47-4d01-b057-c0e6681dcf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:22.534395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d7d83-7b47-4d01-b057-c0e6681dcf1a admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:22.534681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d7d83-7b47-4d01-b057-c0e6681dcf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:22.534964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d7d83-7b47-4d01-b057-c0e6681dcf1a admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:22.539597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d7d83-7b47-4d01-b057-c0e6681dcf1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:22.541927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d7d83-7b47-4d01-b057-c0e6681dcf1a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:22.552631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87203a-b374-4d5b-8a2e-c197c94d62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:22.553377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87203a-b374-4d5b-8a2e-c197c94d62f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:22.553705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87203a-b374-4d5b-8a2e-c197c94d62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:22.555262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87203a-b374-4d5b-8a2e-c197c94d62f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:22.556007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87203a-b374-4d5b-8a2e-c197c94d62f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:22.558753 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87203a-b374-4d5b-8a2e-c197c94d62f7 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:22.596048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1137/2294] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:22 2022] POST /identity/v3/users => generated 299 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:22.597687 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d7d83-7b47-4d01-b057-c0e6681dcf1a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:22.626451 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1158/2295] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:22 2022] POST /identity/v3/projects => generated 373 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:22.626552 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d7d83-7b47-4d01-b057-c0e6681dcf1a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:22.629063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87203a-b374-4d5b-8a2e-c197c94d62f7 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:22.795147 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87203a-b374-4d5b-8a2e-c197c94d62f7 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:22.798374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3254-6fc8-4add-a120-a497da233b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:22.799879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3254-6fc8-4add-a120-a497da233b1a admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:22.800524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3254-6fc8-4add-a120-a497da233b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:22.801158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa3254-6fc8-4add-a120-a497da233b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:22.803367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3254-6fc8-4add-a120-a497da233b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:22.807586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa3254-6fc8-4add-a120-a497da233b1a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:22.811274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27eff7-6fa8-43df-93c5-a8637fe8b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:22.812358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27eff7-6fa8-43df-93c5-a8637fe8b0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:22.812649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27eff7-6fa8-43df-93c5-a8637fe8b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:22.812993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27eff7-6fa8-43df-93c5-a8637fe8b0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:22.814119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27eff7-6fa8-43df-93c5-a8637fe8b0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:22.821003 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27eff7-6fa8-43df-93c5-a8637fe8b0c5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:22.830605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1138/2296] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:22.837891 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3254-6fc8-4add-a120-a497da233b1a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:22.871112 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa3254-6fc8-4add-a120-a497da233b1a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:22.878570 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1159/2297] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:22 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:22.882542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8b40c-6e10-444c-8049-7f07b8c769db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:22.883126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27eff7-6fa8-43df-93c5-a8637fe8b0c5 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:22.887598 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8b40c-6e10-444c-8049-7f07b8c769db admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:22.888413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8b40c-6e10-444c-8049-7f07b8c769db admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:22.889059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8b40c-6e10-444c-8049-7f07b8c769db admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:22.890871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8b40c-6e10-444c-8049-7f07b8c769db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:22.896083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8b40c-6e10-444c-8049-7f07b8c769db admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:22.912078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27eff7-6fa8-43df-93c5-a8637fe8b0c5 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:22.922662 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1139/2298] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:22.927659 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8b40c-6e10-444c-8049-7f07b8c769db admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:22.928746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a2843-c8ad-4f4b-bcf7-36792e63f9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:22.932372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a2843-c8ad-4f4b-bcf7-36792e63f9ec admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:22.933126 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a2843-c8ad-4f4b-bcf7-36792e63f9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:22.935452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a2843-c8ad-4f4b-bcf7-36792e63f9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:22.936472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a2843-c8ad-4f4b-bcf7-36792e63f9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:22.941373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a2843-c8ad-4f4b-bcf7-36792e63f9ec admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:22.955009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8b40c-6e10-444c-8049-7f07b8c769db admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:22.974057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1160/2299] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:22.975308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a2843-c8ad-4f4b-bcf7-36792e63f9ec admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:22.982159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae144958-b14b-4f88-a03e-a50a9b097cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:22.987763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae144958-b14b-4f88-a03e-a50a9b097cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:22.987763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae144958-b14b-4f88-a03e-a50a9b097cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:22.989881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae144958-b14b-4f88-a03e-a50a9b097cf8 admin admin] PATH_INFO: `/v3/projects/81ec27a8126e43e7bb04c8a566793cab/users/288c96ea5c054780a96e83f94b3b5c56/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:23.020277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a2843-c8ad-4f4b-bcf7-36792e63f9ec admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:23.046074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd69bb0-bc2c-4bf7-bd83-c4eb1811eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:23.047547 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd69bb0-bc2c-4bf7-bd83-c4eb1811eaee admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:23.049674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd69bb0-bc2c-4bf7-bd83-c4eb1811eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:23.050380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd69bb0-bc2c-4bf7-bd83-c4eb1811eaee admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:23.054514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd69bb0-bc2c-4bf7-bd83-c4eb1811eaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:23.063683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae144958-b14b-4f88-a03e-a50a9b097cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ec27a8126e43e7bb04c8a566793cab, user_id=288c96ea5c054780a96e83f94b3b5c56, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:23.064463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd69bb0-bc2c-4bf7-bd83-c4eb1811eaee admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:23.078755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae144958-b14b-4f88-a03e-a50a9b097cf8 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:23.119768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1161/2300] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:23.124324 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd69bb0-bc2c-4bf7-bd83-c4eb1811eaee admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:23.133928 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1140/2301] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:22 2022] PUT /identity/v3/projects/81ec27a8126e43e7bb04c8a566793cab/users/288c96ea5c054780a96e83f94b3b5c56/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:56:23.144441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41880-2955-4c2b-820c-51a67d34f8c6 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:23.144726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41880-2955-4c2b-820c-51a67d34f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:23.145008 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b41880-2955-4c2b-820c-51a67d34f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:23.173201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd69bb0-bc2c-4bf7-bd83-c4eb1811eaee admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:23.200822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c5b41880-2955-4c2b-820c-51a67d34f8c6 None None] MFA Rules not processed for user `288c96ea5c054780a96e83f94b3b5c56`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:23.202116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c5b41880-2955-4c2b-820c-51a67d34f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:23.361296 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1141/2302] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:23.379332 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b41880-2955-4c2b-820c-51a67d34f8c6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:23.381771 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c5b41880-2955-4c2b-820c-51a67d34f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:23.398589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7002e6b-4e9f-4ce0-a513-55e622fd29b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:23.402216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7002e6b-4e9f-4ce0-a513-55e622fd29b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:23.402649 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7002e6b-4e9f-4ce0-a513-55e622fd29b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:23.403787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7002e6b-4e9f-4ce0-a513-55e622fd29b6 admin admin] PATH_INFO: `/v3/projects/c485fb8280a9452093556972a276f787/users/5638166fc1894aeba29c5a0317d00249/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:23.454978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7002e6b-4e9f-4ce0-a513-55e622fd29b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c485fb8280a9452093556972a276f787, user_id=5638166fc1894aeba29c5a0317d00249, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:23.472964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7002e6b-4e9f-4ce0-a513-55e622fd29b6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:23.509026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b41880-2955-4c2b-820c-51a67d34f8c6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:23.515572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1162/2303] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:23 2022] PUT /identity/v3/projects/c485fb8280a9452093556972a276f787/users/5638166fc1894aeba29c5a0317d00249/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:23.520870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f094050-664c-4925-b3c5-6d8f559a98d9 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:23.521292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f094050-664c-4925-b3c5-6d8f559a98d9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:23.521712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f094050-664c-4925-b3c5-6d8f559a98d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:23.562994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3f094050-664c-4925-b3c5-6d8f559a98d9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:23.564474 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3f094050-664c-4925-b3c5-6d8f559a98d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:23.739352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1163/2304] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:23.758937 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45b55-d535-46f9-89dc-2dd2ea1bde46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:23.760874 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45b55-d535-46f9-89dc-2dd2ea1bde46 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:23.761394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45b55-d535-46f9-89dc-2dd2ea1bde46 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:23.761922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a45b55-d535-46f9-89dc-2dd2ea1bde46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:23.792966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f094050-664c-4925-b3c5-6d8f559a98d9 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:23.795196 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3f094050-664c-4925-b3c5-6d8f559a98d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:23.948506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f094050-664c-4925-b3c5-6d8f559a98d9 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:23.953460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdae485-8671-450f-aab2-86ba7b71f549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:23.954376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdae485-8671-450f-aab2-86ba7b71f549 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:23.954824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdae485-8671-450f-aab2-86ba7b71f549 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:23.955256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdae485-8671-450f-aab2-86ba7b71f549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:23.972868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdae485-8671-450f-aab2-86ba7b71f549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:23.975440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdae485-8671-450f-aab2-86ba7b71f549 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:23.992762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1164/2305] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:24.001420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a45b55-d535-46f9-89dc-2dd2ea1bde46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:24.003505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a45b55-d535-46f9-89dc-2dd2ea1bde46 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:24.024495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1142/2306] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:24.334734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8aae7-e74f-41be-a9c2-03354f8da029 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:24.335552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8aae7-e74f-41be-a9c2-03354f8da029 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:24.337765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8aae7-e74f-41be-a9c2-03354f8da029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:24.399167 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-43b8aae7-e74f-41be-a9c2-03354f8da029 None None] MFA Rules not processed for user `00d5aeec35784bfb80b431605ef02a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:24.402033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-43b8aae7-e74f-41be-a9c2-03354f8da029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:24.561690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45b55-d535-46f9-89dc-2dd2ea1bde46 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:24.564116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-24a45b55-d535-46f9-89dc-2dd2ea1bde46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:24.585848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1165/2307] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:24.587628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8aae7-e74f-41be-a9c2-03354f8da029 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:24.593024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-43b8aae7-e74f-41be-a9c2-03354f8da029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:24.615058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a45b55-d535-46f9-89dc-2dd2ea1bde46 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:24.649705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:24.652264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:24.656350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:24.657312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] PATH_INFO: `/v3/projects/397aaa6cfb2a4e58b37fc5e358b9aa2a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:24.662921 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=397aaa6cfb2a4e58b37fc5e358b9aa2a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:24.668078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:24.846538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397aaa6cfb2a4e58b37fc5e358b9aa2a', 'request_id': 'req-b3479b6e-5667-431d-af0a-6b572d75f5cf'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:24.870228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397aaa6cfb2a4e58b37fc5e358b9aa2a', 'request_id': 'req-b3479b6e-5667-431d-af0a-6b572d75f5cf'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:24.902830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397aaa6cfb2a4e58b37fc5e358b9aa2a', 'request_id': 'req-b3479b6e-5667-431d-af0a-6b572d75f5cf'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:24.946595 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] The token cache is being invalidate because project 397aaa6cfb2a4e58b37fc5e358b9aa2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:24.959356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:24.964986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:24.972956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1143/2308] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:24 2022] DELETE /identity/v3/projects/397aaa6cfb2a4e58b37fc5e358b9aa2a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:56:24.976112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8aae7-e74f-41be-a9c2-03354f8da029 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:24.977101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:24.986665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:25.280053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3479b6e-5667-431d-af0a-6b572d75f5cf admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:25.290076 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9bf87-8b30-431d-bd01-8d4295fcebef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:25.295573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9bf87-8b30-431d-bd01-8d4295fcebef service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:25.296502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9bf87-8b30-431d-bd01-8d4295fcebef service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:25.297061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9bf87-8b30-431d-bd01-8d4295fcebef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:25.312583 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e6b9bf87-8b30-431d-bd01-8d4295fcebef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:25.336833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbeb43-fcc1-430f-8cde-9bdce4af5829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:25.338734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbeb43-fcc1-430f-8cde-9bdce4af5829 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:25.339463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbeb43-fcc1-430f-8cde-9bdce4af5829 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:25.340134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbeb43-fcc1-430f-8cde-9bdce4af5829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:25.343955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-22bbeb43-fcc1-430f-8cde-9bdce4af5829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:25.499615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9bf87-8b30-431d-bd01-8d4295fcebef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:25.501863 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9bf87-8b30-431d-bd01-8d4295fcebef service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:25.539630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1144/2309] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:25.540540 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9bf87-8b30-431d-bd01-8d4295fcebef service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:25.542582 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e6b9bf87-8b30-431d-bd01-8d4295fcebef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:25.555303 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbeb43-fcc1-430f-8cde-9bdce4af5829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:25.565684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbeb43-fcc1-430f-8cde-9bdce4af5829 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:25.626619 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1166/2310] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 1040 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:25.730343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9bf87-8b30-431d-bd01-8d4295fcebef service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:25.747529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:25.748671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:25.750084 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:25.750556 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] PATH_INFO: `/v3/users/ea5d73f3975a4fbbba8944125ec61b92` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:25.752170 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5d73f3975a4fbbba8944125ec61b92)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:25.754779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:25.836515 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5d73f3975a4fbbba8944125ec61b92'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:25.837233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5d73f3975a4fbbba8944125ec61b92'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:25.839618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5d73f3975a4fbbba8944125ec61b92'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:25.857558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5d73f3975a4fbbba8944125ec61b92'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:25.887986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5d73f3975a4fbbba8944125ec61b92'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:25.913665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1145/2311] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:25 2022] DELETE /identity/v3/users/ea5d73f3975a4fbbba8944125ec61b92 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:26.641566 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1604b-20c4-4cb1-9947-0ee055d2f1b4 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:26.642530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1604b-20c4-4cb1-9947-0ee055d2f1b4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:26.642530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1604b-20c4-4cb1-9947-0ee055d2f1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:26.716665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-74e1604b-20c4-4cb1-9947-0ee055d2f1b4 None None] MFA Rules not processed for user `5638166fc1894aeba29c5a0317d00249`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:26.717982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-74e1604b-20c4-4cb1-9947-0ee055d2f1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:26.980479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1167/2312] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:26.986079 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:26.991420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:27.337839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83eef7b-fdf1-41f9-a18a-2d9c9d306d55 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:27.356625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c1afc-5a0f-4d5b-b53b-580d901f8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:27.361762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c1afc-5a0f-4d5b-b53b-580d901f8435 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:27.362264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c1afc-5a0f-4d5b-b53b-580d901f8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:27.362780 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c1afc-5a0f-4d5b-b53b-580d901f8435 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:27.367747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c1afc-5a0f-4d5b-b53b-580d901f8435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:27.373158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1604b-20c4-4cb1-9947-0ee055d2f1b4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:27.375014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-74e1604b-20c4-4cb1-9947-0ee055d2f1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:27.382500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c1afc-5a0f-4d5b-b53b-580d901f8435 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:27.430950 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1604b-20c4-4cb1-9947-0ee055d2f1b4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:27.447912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:27.450007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:27.450415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:27.450796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] PATH_INFO: `/v3/projects/8faa026bbdc6425c851f931ad88f61ea` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:27.453052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8faa026bbdc6425c851f931ad88f61ea)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:27.457458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:27.491047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1146/2313] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:26 2022] POST /identity/v3/projects => generated 373 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:27.496311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c1afc-5a0f-4d5b-b53b-580d901f8435 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:27.593225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8faa026bbdc6425c851f931ad88f61ea', 'request_id': 'req-f6695834-0f8c-4ab2-8cf8-664db20c3008'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:27.610876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8faa026bbdc6425c851f931ad88f61ea', 'request_id': 'req-f6695834-0f8c-4ab2-8cf8-664db20c3008'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:27.637287 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8faa026bbdc6425c851f931ad88f61ea', 'request_id': 'req-f6695834-0f8c-4ab2-8cf8-664db20c3008'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:27.658067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] The token cache is being invalidate because project 8faa026bbdc6425c851f931ad88f61ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:27.658758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:27.660611 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-f6695834-0f8c-4ab2-8cf8-664db20c3008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:27.662340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1168/2314] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:27 2022] DELETE /identity/v3/projects/8faa026bbdc6425c851f931ad88f61ea => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:27.674768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9eff2-d50f-4592-b16e-128eeef4abcc None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:27.675254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9eff2-d50f-4592-b16e-128eeef4abcc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:27.676473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9eff2-d50f-4592-b16e-128eeef4abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:27.684529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c1afc-5a0f-4d5b-b53b-580d901f8435 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:27.732857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-82b9eff2-d50f-4592-b16e-128eeef4abcc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:27.734581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-82b9eff2-d50f-4592-b16e-128eeef4abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:27.884069 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59df089-f310-4137-84cf-afb6a38187d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:27.889007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59df089-f310-4137-84cf-afb6a38187d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:27.893016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59df089-f310-4137-84cf-afb6a38187d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:27.893609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59df089-f310-4137-84cf-afb6a38187d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:27.895669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59df089-f310-4137-84cf-afb6a38187d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:27.903264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59df089-f310-4137-84cf-afb6a38187d9 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:27.961880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1147/2315] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:27 2022] POST /identity/v3/users => generated 293 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:56:27.964560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f147-b9e7-413f-a707-87cef3a4329c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:27.964836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f147-b9e7-413f-a707-87cef3a4329c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:27.967585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776f147-b9e7-413f-a707-87cef3a4329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:27.971209 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1169/2316] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:27.973276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9eff2-d50f-4592-b16e-128eeef4abcc None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:27.976525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-82b9eff2-d50f-4592-b16e-128eeef4abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:28.011005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9eff2-d50f-4592-b16e-128eeef4abcc None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:28.024292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348704f-545a-4b31-8c4f-16573b7a625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:28.026745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348704f-545a-4b31-8c4f-16573b7a625a admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:28.027932 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348704f-545a-4b31-8c4f-16573b7a625a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:28.028840 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348704f-545a-4b31-8c4f-16573b7a625a admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:28.031269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348704f-545a-4b31-8c4f-16573b7a625a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:28.034662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348704f-545a-4b31-8c4f-16573b7a625a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:28.054810 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-1776f147-b9e7-413f-a707-87cef3a4329c None None] MFA Rules not processed for user `ef623fa30c4647e18d9dd3f81704e0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:28.057047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1776f147-b9e7-413f-a707-87cef3a4329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:28.081268 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1170/2317] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:28.088509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baed6d6-7a6c-4db8-9576-bb0d8a0d39fc None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:28.090839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baed6d6-7a6c-4db8-9576-bb0d8a0d39fc None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:28.092725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baed6d6-7a6c-4db8-9576-bb0d8a0d39fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:28.167096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5baed6d6-7a6c-4db8-9576-bb0d8a0d39fc None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:28.169424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5baed6d6-7a6c-4db8-9576-bb0d8a0d39fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:28.205330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1171/2318] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:28.207265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baed6d6-7a6c-4db8-9576-bb0d8a0d39fc None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:28.230978 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baed6d6-7a6c-4db8-9576-bb0d8a0d39fc None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:28.242430 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cc48c-4dc9-4bd9-b309-811b66bf9265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:28.245383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cc48c-4dc9-4bd9-b309-811b66bf9265 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:28.245617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cc48c-4dc9-4bd9-b309-811b66bf9265 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:28.246637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cc48c-4dc9-4bd9-b309-811b66bf9265 admin admin] PATH_INFO: `/v3/projects/e89cb9102f6243ffbb577ae034ab6a7f/users/763b183f89294a2ea3bcc81b56a3990f/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:28.306122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cc48c-4dc9-4bd9-b309-811b66bf9265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89cb9102f6243ffbb577ae034ab6a7f, user_id=763b183f89294a2ea3bcc81b56a3990f, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:28.323267 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cc48c-4dc9-4bd9-b309-811b66bf9265 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:28.343025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1148/2319] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:28.343946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776f147-b9e7-413f-a707-87cef3a4329c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:28.357644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1172/2320] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:28 2022] PUT /identity/v3/projects/e89cb9102f6243ffbb577ae034ab6a7f/users/763b183f89294a2ea3bcc81b56a3990f/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:28.363186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cc48c-4dc9-4bd9-b309-811b66bf9265 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:28.367412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4d1cc48c-4dc9-4bd9-b309-811b66bf9265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:28.374304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776f147-b9e7-413f-a707-87cef3a4329c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:28.532549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e44bf-e138-4594-85ba-1919f040abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:28.533251 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e44bf-e138-4594-85ba-1919f040abaf admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:28.533715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e44bf-e138-4594-85ba-1919f040abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:28.533999 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e44bf-e138-4594-85ba-1919f040abaf admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:28.535116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e44bf-e138-4594-85ba-1919f040abaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:28.535255 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e44bf-e138-4594-85ba-1919f040abaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:28.536886 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e44bf-e138-4594-85ba-1919f040abaf admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:28.565799 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1149/2321] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:28.565799 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e44bf-e138-4594-85ba-1919f040abaf admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:28.590698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e44bf-e138-4594-85ba-1919f040abaf admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:28.614432 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea8720-15c9-41e5-9cc5-d9905b89c548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:28.615155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea8720-15c9-41e5-9cc5-d9905b89c548 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:28.615446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea8720-15c9-41e5-9cc5-d9905b89c548 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:28.615729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea8720-15c9-41e5-9cc5-d9905b89c548 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:28.616490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea8720-15c9-41e5-9cc5-d9905b89c548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:28.618207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea8720-15c9-41e5-9cc5-d9905b89c548 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:28.634228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1150/2322] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:28.636455 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea8720-15c9-41e5-9cc5-d9905b89c548 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:28.651289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cc48c-4dc9-4bd9-b309-811b66bf9265 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:28.664119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a7986-6f15-4446-b776-0042024ff08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:28.665381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a7986-6f15-4446-b776-0042024ff08e admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:28.666569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a7986-6f15-4446-b776-0042024ff08e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:28.667149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a7986-6f15-4446-b776-0042024ff08e admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:28.668775 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a7986-6f15-4446-b776-0042024ff08e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:28.671684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea8720-15c9-41e5-9cc5-d9905b89c548 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:28.674423 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a7986-6f15-4446-b776-0042024ff08e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:28.688808 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6242c-f6cd-451e-8ce5-6ba390392e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:28.689941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6242c-f6cd-451e-8ce5-6ba390392e79 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:28.690281 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6242c-f6cd-451e-8ce5-6ba390392e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:28.690704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6242c-f6cd-451e-8ce5-6ba390392e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:28.691810 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6242c-f6cd-451e-8ce5-6ba390392e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:28.695089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6242c-f6cd-451e-8ce5-6ba390392e79 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:28.743143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1151/2323] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:28 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:28.744547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6242c-f6cd-451e-8ce5-6ba390392e79 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:28.753417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1173/2324] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:28 2022] POST /identity/v3/projects => generated 379 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:28.755895 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a7986-6f15-4446-b776-0042024ff08e admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:28.827474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6242c-f6cd-451e-8ce5-6ba390392e79 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:28.878684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a7986-6f15-4446-b776-0042024ff08e admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:28.883778 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288b430-e39e-4350-9118-6adb94ae4c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:28.885243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b430-e39e-4350-9118-6adb94ae4c73 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:28.885509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b430-e39e-4350-9118-6adb94ae4c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:28.885872 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288b430-e39e-4350-9118-6adb94ae4c73 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:28.889330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288b430-e39e-4350-9118-6adb94ae4c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:28.892225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288b430-e39e-4350-9118-6adb94ae4c73 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:28.926994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae6cbc-b156-4d40-bc5f-79ec1c0f94a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:28.929143 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae6cbc-b156-4d40-bc5f-79ec1c0f94a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:28.929521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae6cbc-b156-4d40-bc5f-79ec1c0f94a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:28.929787 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae6cbc-b156-4d40-bc5f-79ec1c0f94a1 admin admin] PATH_INFO: `/v3/projects/e89cb9102f6243ffbb577ae034ab6a7f/users/763b183f89294a2ea3bcc81b56a3990f/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:28.941790 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae6cbc-b156-4d40-bc5f-79ec1c0f94a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89cb9102f6243ffbb577ae034ab6a7f, user_id=763b183f89294a2ea3bcc81b56a3990f, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:28.948834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae6cbc-b156-4d40-bc5f-79ec1c0f94a1 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:28.952647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1174/2325] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:28 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:28.953625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288b430-e39e-4350-9118-6adb94ae4c73 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:28.964644 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1152/2326] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:28 2022] PUT /identity/v3/projects/e89cb9102f6243ffbb577ae034ab6a7f/users/763b183f89294a2ea3bcc81b56a3990f/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:28.965537 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae6cbc-b156-4d40-bc5f-79ec1c0f94a1 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:28.967779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288b430-e39e-4350-9118-6adb94ae4c73 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:29.131157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae6cbc-b156-4d40-bc5f-79ec1c0f94a1 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:29.141414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c84b3-56df-40f8-9c90-a2c3fd8deaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:29.143015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c84b3-56df-40f8-9c90-a2c3fd8deaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.143461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c84b3-56df-40f8-9c90-a2c3fd8deaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.144059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c84b3-56df-40f8-9c90-a2c3fd8deaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.145126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c84b3-56df-40f8-9c90-a2c3fd8deaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:29.148178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c84b3-56df-40f8-9c90-a2c3fd8deaa1 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:29.163327 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4077-261a-49cc-bc34-43a890bbc18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:29.164348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1153/2327] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:29.167898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c84b3-56df-40f8-9c90-a2c3fd8deaa1 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:29.168248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4077-261a-49cc-bc34-43a890bbc18e admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.168802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4077-261a-49cc-bc34-43a890bbc18e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.169091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4077-261a-49cc-bc34-43a890bbc18e admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.170017 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f4077-261a-49cc-bc34-43a890bbc18e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:29.174062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f4077-261a-49cc-bc34-43a890bbc18e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:29.182727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c84b3-56df-40f8-9c90-a2c3fd8deaa1 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:29.198072 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52180327-580a-48e0-ad3f-bc6626371ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:29.201065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52180327-580a-48e0-ad3f-bc6626371ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.202257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52180327-580a-48e0-ad3f-bc6626371ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.204230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52180327-580a-48e0-ad3f-bc6626371ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.205677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52180327-580a-48e0-ad3f-bc6626371ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:29.208207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52180327-580a-48e0-ad3f-bc6626371ee2 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:29.223994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1175/2328] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:28 2022] POST /identity/v3/users => generated 296 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:29.225652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1154/2329] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:56:29.229971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4077-261a-49cc-bc34-43a890bbc18e admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:29.235798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52180327-580a-48e0-ad3f-bc6626371ee2 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:29.253881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4077-261a-49cc-bc34-43a890bbc18e admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:29.264558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52180327-580a-48e0-ad3f-bc6626371ee2 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:29.266710 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24943a49-bae6-4acb-b76a-4415b11bc74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:29.268020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24943a49-bae6-4acb-b76a-4415b11bc74e admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.268300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24943a49-bae6-4acb-b76a-4415b11bc74e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.269828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24943a49-bae6-4acb-b76a-4415b11bc74e admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.272401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24943a49-bae6-4acb-b76a-4415b11bc74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:29.278360 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21163f-1e4e-44aa-a23c-daea09580244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:29.279925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21163f-1e4e-44aa-a23c-daea09580244 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.280405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24943a49-bae6-4acb-b76a-4415b11bc74e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:29.281189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21163f-1e4e-44aa-a23c-daea09580244 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.292477 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21163f-1e4e-44aa-a23c-daea09580244 admin admin] PATH_INFO: `/v3/projects/cc16db8075164e4aa4e7b3346b7e260b/users/64730ae538b145708eb4e1edf36fea36/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.305500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1176/2330] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:29.310883 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24943a49-bae6-4acb-b76a-4415b11bc74e admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:29.348276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24943a49-bae6-4acb-b76a-4415b11bc74e admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:29.351471 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21163f-1e4e-44aa-a23c-daea09580244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc16db8075164e4aa4e7b3346b7e260b, user_id=64730ae538b145708eb4e1edf36fea36, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:29.354965 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21163f-1e4e-44aa-a23c-daea09580244 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:29.371852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03e625-c3f7-416d-b510-1d7b767fa78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:29.373655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e625-c3f7-416d-b510-1d7b767fa78d admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.373655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e625-c3f7-416d-b510-1d7b767fa78d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.373655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e625-c3f7-416d-b510-1d7b767fa78d admin admin] PATH_INFO: `/v3/projects/ffd1a2290fa344c692bd4100baddeec0/users/88f8874ff4194925960c748e01ede56b/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.388041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1155/2331] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:29 2022] PUT /identity/v3/projects/cc16db8075164e4aa4e7b3346b7e260b/users/64730ae538b145708eb4e1edf36fea36/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:29.409439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fdac8-c085-4cb5-8369-e97fe043e837 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.409833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fdac8-c085-4cb5-8369-e97fe043e837 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.410687 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fdac8-c085-4cb5-8369-e97fe043e837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.412466 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03e625-c3f7-416d-b510-1d7b767fa78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd1a2290fa344c692bd4100baddeec0, user_id=88f8874ff4194925960c748e01ede56b, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:29.430164 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03e625-c3f7-416d-b510-1d7b767fa78d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:29.475432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1177/2332] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:29 2022] PUT /identity/v3/projects/ffd1a2290fa344c692bd4100baddeec0/users/88f8874ff4194925960c748e01ede56b/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:29.477036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03e625-c3f7-416d-b510-1d7b767fa78d admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:29.496763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-a88fdac8-c085-4cb5-8369-e97fe043e837 None None] MFA Rules not processed for user `64730ae538b145708eb4e1edf36fea36`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:29.498905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a88fdac8-c085-4cb5-8369-e97fe043e837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:29.674885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1156/2333] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:29.688606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fdac8-c085-4cb5-8369-e97fe043e837 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:29.696627 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03e625-c3f7-416d-b510-1d7b767fa78d admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:29.705645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fdac8-c085-4cb5-8369-e97fe043e837 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:29.713816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14418564-5e89-4389-a2ea-8056e414a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:29.714952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14418564-5e89-4389-a2ea-8056e414a101 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.717380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14418564-5e89-4389-a2ea-8056e414a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.717966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14418564-5e89-4389-a2ea-8056e414a101 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.718414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bfadc-fe42-40c4-acc1-e8068eca0c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:29.719581 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bfadc-fe42-40c4-acc1-e8068eca0c49 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.720104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14418564-5e89-4389-a2ea-8056e414a101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:29.720562 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bfadc-fe42-40c4-acc1-e8068eca0c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.723665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bfadc-fe42-40c4-acc1-e8068eca0c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.725178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bfadc-fe42-40c4-acc1-e8068eca0c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:29.727506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bfadc-fe42-40c4-acc1-e8068eca0c49 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:29.734855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14418564-5e89-4389-a2ea-8056e414a101 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:29.753638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1178/2334] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:56:29.758708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14418564-5e89-4389-a2ea-8056e414a101 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:29.783597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1157/2335] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:29 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:29.786325 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14418564-5e89-4389-a2ea-8056e414a101 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:29.787807 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bfadc-fe42-40c4-acc1-e8068eca0c49 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:29.911774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bfadc-fe42-40c4-acc1-e8068eca0c49 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:29.929607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c887-2b25-45d4-bb75-a8f34c6cb184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:29.932730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c887-2b25-45d4-bb75-a8f34c6cb184 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.933359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c887-2b25-45d4-bb75-a8f34c6cb184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.935095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9c887-2b25-45d4-bb75-a8f34c6cb184 admin admin] PATH_INFO: `/v3/projects/ffd1a2290fa344c692bd4100baddeec0/users/88f8874ff4194925960c748e01ede56b/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.938358 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9c887-2b25-45d4-bb75-a8f34c6cb184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd1a2290fa344c692bd4100baddeec0, user_id=88f8874ff4194925960c748e01ede56b, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:29.939628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14602f2e-7dea-4645-b028-370fbc460a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:29.942276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14602f2e-7dea-4645-b028-370fbc460a2a admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:29.943648 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14602f2e-7dea-4645-b028-370fbc460a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:29.944009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14602f2e-7dea-4645-b028-370fbc460a2a admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:29.945631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9c887-2b25-45d4-bb75-a8f34c6cb184 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:29.945917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14602f2e-7dea-4645-b028-370fbc460a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:29.951406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14602f2e-7dea-4645-b028-370fbc460a2a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:29.974102 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1179/2336] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:29 2022] PUT /identity/v3/projects/ffd1a2290fa344c692bd4100baddeec0/users/88f8874ff4194925960c748e01ede56b/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:30.013131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1158/2337] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:29 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:30.015367 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c887-2b25-45d4-bb75-a8f34c6cb184 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:30.183857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9c887-2b25-45d4-bb75-a8f34c6cb184 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:30.189086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023d331-c8e1-40f2-a243-52926cb218c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:30.189810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d331-c8e1-40f2-a243-52926cb218c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:30.190098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d331-c8e1-40f2-a243-52926cb218c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:30.190662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d331-c8e1-40f2-a243-52926cb218c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:30.191428 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023d331-c8e1-40f2-a243-52926cb218c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:30.193106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023d331-c8e1-40f2-a243-52926cb218c2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:30.219436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1180/2338] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:30.222791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14602f2e-7dea-4645-b028-370fbc460a2a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:30.238867 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14602f2e-7dea-4645-b028-370fbc460a2a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:30.253450 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71fb95-1cb7-49dc-84c4-572daef28806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:30.256159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71fb95-1cb7-49dc-84c4-572daef28806 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:30.256487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71fb95-1cb7-49dc-84c4-572daef28806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:30.257031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71fb95-1cb7-49dc-84c4-572daef28806 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:30.259625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71fb95-1cb7-49dc-84c4-572daef28806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:30.264614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71fb95-1cb7-49dc-84c4-572daef28806 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:30.292975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1159/2339] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:30.298450 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023d331-c8e1-40f2-a243-52926cb218c2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:30.335797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023d331-c8e1-40f2-a243-52926cb218c2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:30.349921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734704e7-2fc8-4df2-b526-1a922b12a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:30.351673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734704e7-2fc8-4df2-b526-1a922b12a254 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:30.352255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734704e7-2fc8-4df2-b526-1a922b12a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:30.352814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734704e7-2fc8-4df2-b526-1a922b12a254 admin admin] PATH_INFO: `/v3/projects/f672c3abb592408e9aacf94c12a17485/users/1b68b0a95b254433a6a018fee3cb8e51/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:30.377862 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734704e7-2fc8-4df2-b526-1a922b12a254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f672c3abb592408e9aacf94c12a17485, user_id=1b68b0a95b254433a6a018fee3cb8e51, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:30.383021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734704e7-2fc8-4df2-b526-1a922b12a254 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:30.456826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1181/2340] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:30 2022] PUT /identity/v3/projects/f672c3abb592408e9aacf94c12a17485/users/1b68b0a95b254433a6a018fee3cb8e51/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:30.468783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeff6ff-db52-4ae3-a8a0-f0fa2f687c15 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:30.469615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeff6ff-db52-4ae3-a8a0-f0fa2f687c15 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:30.469911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeff6ff-db52-4ae3-a8a0-f0fa2f687c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:30.546469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-4eeff6ff-db52-4ae3-a8a0-f0fa2f687c15 None None] MFA Rules not processed for user `1b68b0a95b254433a6a018fee3cb8e51`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:30.551884 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4eeff6ff-db52-4ae3-a8a0-f0fa2f687c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:30.830876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1160/2341] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:30.832605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734704e7-2fc8-4df2-b526-1a922b12a254 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:31.195467 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734704e7-2fc8-4df2-b526-1a922b12a254 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:31.211409 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cb926-f8d9-4537-a922-e3d77a30baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:31.217827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb926-f8d9-4537-a922-e3d77a30baa5 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:31.218574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb926-f8d9-4537-a922-e3d77a30baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:31.220028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cb926-f8d9-4537-a922-e3d77a30baa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:31.230818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb926-f8d9-4537-a922-e3d77a30baa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:31.236548 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cb926-f8d9-4537-a922-e3d77a30baa5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:31.412785 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1182/2342] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:30 2022] POST /identity/v3/projects => generated 383 bytes in 581 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:56:31.420580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeff6ff-db52-4ae3-a8a0-f0fa2f687c15 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:31.453084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65730f-58e5-4197-a906-440ac2c9c485 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:31.453295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65730f-58e5-4197-a906-440ac2c9c485 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:31.453645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65730f-58e5-4197-a906-440ac2c9c485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:31.455867 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeff6ff-db52-4ae3-a8a0-f0fa2f687c15 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:31.534946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-6f65730f-58e5-4197-a906-440ac2c9c485 None None] MFA Rules not processed for user `763b183f89294a2ea3bcc81b56a3990f`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:31.538344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6f65730f-58e5-4197-a906-440ac2c9c485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:31.648660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f751784-8002-4d7c-ae7c-20e45f0daa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:31.649674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f751784-8002-4d7c-ae7c-20e45f0daa29 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:31.651910 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f751784-8002-4d7c-ae7c-20e45f0daa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:31.652967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f751784-8002-4d7c-ae7c-20e45f0daa29 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:31.654387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f751784-8002-4d7c-ae7c-20e45f0daa29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:31.659171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f751784-8002-4d7c-ae7c-20e45f0daa29 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:31.715769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1161/2343] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:31 2022] POST /identity/v3/users => generated 298 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:31.718746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bbac9-ae96-481e-b816-f2e4c7edf142 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:31.721035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bbac9-ae96-481e-b816-f2e4c7edf142 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:31.721497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bbac9-ae96-481e-b816-f2e4c7edf142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:31.732764 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1183/2344] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:31.738686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65730f-58e5-4197-a906-440ac2c9c485 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:31.756771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65730f-58e5-4197-a906-440ac2c9c485 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:31.765141 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7e24-bed0-4095-9a2b-52e0fc041bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:31.766489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7e24-bed0-4095-9a2b-52e0fc041bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:31.767925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7e24-bed0-4095-9a2b-52e0fc041bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:31.768444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c7e24-bed0-4095-9a2b-52e0fc041bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:31.769542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c7e24-bed0-4095-9a2b-52e0fc041bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:31.772119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c7e24-bed0-4095-9a2b-52e0fc041bd5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:31.782705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-754bbac9-ae96-481e-b816-f2e4c7edf142 None None] MFA Rules not processed for user `00d5aeec35784bfb80b431605ef02a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:31.784029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-754bbac9-ae96-481e-b816-f2e4c7edf142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:31.795465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1184/2345] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:31.796724 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7e24-bed0-4095-9a2b-52e0fc041bd5 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:31.798785 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c02c7e24-bed0-4095-9a2b-52e0fc041bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:31.912524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c7e24-bed0-4095-9a2b-52e0fc041bd5 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:31.922285 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890f6ef-a396-4e7c-9510-e48b9d42055e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:31.924728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890f6ef-a396-4e7c-9510-e48b9d42055e service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:31.925010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890f6ef-a396-4e7c-9510-e48b9d42055e service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:31.925287 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890f6ef-a396-4e7c-9510-e48b9d42055e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:31.928217 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1162/2346] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:31.929096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bbac9-ae96-481e-b816-f2e4c7edf142 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:31.930703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8890f6ef-a396-4e7c-9510-e48b9d42055e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:31.956528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bbac9-ae96-481e-b816-f2e4c7edf142 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:31.970746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cbed4-0753-4dda-9d6c-b09e666828ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:31.973878 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cbed4-0753-4dda-9d6c-b09e666828ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:31.974321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cbed4-0753-4dda-9d6c-b09e666828ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:31.974669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cbed4-0753-4dda-9d6c-b09e666828ff admin admin] PATH_INFO: `/v3/projects/161158cc9e5b4027bf6d0bcc3dcc9d17/users/d31addf0dbe14529936b5300bab81216/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:32.019357 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cbed4-0753-4dda-9d6c-b09e666828ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=161158cc9e5b4027bf6d0bcc3dcc9d17, user_id=d31addf0dbe14529936b5300bab81216, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:32.023040 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cbed4-0753-4dda-9d6c-b09e666828ff admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:32.101366 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1163/2347] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:31 2022] PUT /identity/v3/projects/161158cc9e5b4027bf6d0bcc3dcc9d17/users/d31addf0dbe14529936b5300bab81216/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:32.107563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cbed4-0753-4dda-9d6c-b09e666828ff admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:32.147149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890f6ef-a396-4e7c-9510-e48b9d42055e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:32.151999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890f6ef-a396-4e7c-9510-e48b9d42055e service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:32.187968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1185/2348] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:32.316367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cbed4-0753-4dda-9d6c-b09e666828ff admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:32.348375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803f925-4341-431a-8aeb-3c29b6fc32ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:32.349225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803f925-4341-431a-8aeb-3c29b6fc32ac admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:32.349884 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803f925-4341-431a-8aeb-3c29b6fc32ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:32.350270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803f925-4341-431a-8aeb-3c29b6fc32ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:32.353441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803f925-4341-431a-8aeb-3c29b6fc32ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:32.362474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803f925-4341-431a-8aeb-3c29b6fc32ac admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:32.394152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1164/2349] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:32.398530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890f6ef-a396-4e7c-9510-e48b9d42055e service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:32.414347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890f6ef-a396-4e7c-9510-e48b9d42055e service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:32.432581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f399d6-2ad9-4f4b-8cec-984351be7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:32.433515 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f399d6-2ad9-4f4b-8cec-984351be7891 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:32.433943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f399d6-2ad9-4f4b-8cec-984351be7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:32.434220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f399d6-2ad9-4f4b-8cec-984351be7891 admin admin] PATH_INFO: `/v3/projects/161158cc9e5b4027bf6d0bcc3dcc9d17/users/d31addf0dbe14529936b5300bab81216/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:32.451774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f399d6-2ad9-4f4b-8cec-984351be7891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=161158cc9e5b4027bf6d0bcc3dcc9d17, user_id=d31addf0dbe14529936b5300bab81216, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:32.455286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f399d6-2ad9-4f4b-8cec-984351be7891 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:32.494289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1186/2350] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:32 2022] PUT /identity/v3/projects/161158cc9e5b4027bf6d0bcc3dcc9d17/users/d31addf0dbe14529936b5300bab81216/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:56:32.506539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c088c-19e3-4edf-a7d8-675c0702e5d6 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:32.508139 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c088c-19e3-4edf-a7d8-675c0702e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:32.508604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c088c-19e3-4edf-a7d8-675c0702e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:32.579182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-cd1c088c-19e3-4edf-a7d8-675c0702e5d6 None None] MFA Rules not processed for user `d31addf0dbe14529936b5300bab81216`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:32.580916 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-cd1c088c-19e3-4edf-a7d8-675c0702e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:32.769884 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1165/2351] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:32.807825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f399d6-2ad9-4f4b-8cec-984351be7891 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:32.809902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-39f399d6-2ad9-4f4b-8cec-984351be7891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:32.834903 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c088c-19e3-4edf-a7d8-675c0702e5d6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:32.838225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-cd1c088c-19e3-4edf-a7d8-675c0702e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:32.983486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f399d6-2ad9-4f4b-8cec-984351be7891 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:32.991889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:32.992802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:32.993092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:32.993363 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] PATH_INFO: `/v3/users/64eb50bb707e4fcfa5b940dc47538251` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:33.002991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64eb50bb707e4fcfa5b940dc47538251)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:33.017009 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:33.048932 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c088c-19e3-4edf-a7d8-675c0702e5d6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:33.061744 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b4ab1-527a-46bb-8103-562a841018fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:33.061971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b4ab1-527a-46bb-8103-562a841018fc service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:33.062375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b4ab1-527a-46bb-8103-562a841018fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:33.062839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b4ab1-527a-46bb-8103-562a841018fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:33.132042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64eb50bb707e4fcfa5b940dc47538251'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:33.132803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64eb50bb707e4fcfa5b940dc47538251'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:33.133415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64eb50bb707e4fcfa5b940dc47538251'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:33.148193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64eb50bb707e4fcfa5b940dc47538251'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:33.169032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d63247a0-a0b3-439e-ade9-2a148b45e74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64eb50bb707e4fcfa5b940dc47538251'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:33.186985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1187/2352] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:32 2022] DELETE /identity/v3/users/64eb50bb707e4fcfa5b940dc47538251 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:56:33.195496 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e13e1-1cce-4c7c-b52e-08385b7275e9 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:33.196045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e13e1-1cce-4c7c-b52e-08385b7275e9 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:33.196487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e13e1-1cce-4c7c-b52e-08385b7275e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:33.224390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b4ab1-527a-46bb-8103-562a841018fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:33.241328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-354e13e1-1cce-4c7c-b52e-08385b7275e9 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:33.242944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-354e13e1-1cce-4c7c-b52e-08385b7275e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:33.254728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b4ab1-527a-46bb-8103-562a841018fc service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:33.286290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1166/2353] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:33.473605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1188/2354] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:33.498069 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b4ab1-527a-46bb-8103-562a841018fc service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:33.500268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ed6b4ab1-527a-46bb-8103-562a841018fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:33.640005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b4ab1-527a-46bb-8103-562a841018fc service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:33.707612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e13e1-1cce-4c7c-b52e-08385b7275e9 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:33.709243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-354e13e1-1cce-4c7c-b52e-08385b7275e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:33.765468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e13e1-1cce-4c7c-b52e-08385b7275e9 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:33.766961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da89ba-b20f-4514-ad69-0c025ab37318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:33.768068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da89ba-b20f-4514-ad69-0c025ab37318 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:33.768837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da89ba-b20f-4514-ad69-0c025ab37318 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:33.769289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da89ba-b20f-4514-ad69-0c025ab37318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:33.782719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da89ba-b20f-4514-ad69-0c025ab37318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:33.787389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da89ba-b20f-4514-ad69-0c025ab37318 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:33.796542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:33.798210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:33.801278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:33.801899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] PATH_INFO: `/v3/users/288c96ea5c054780a96e83f94b3b5c56` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:33.804943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=288c96ea5c054780a96e83f94b3b5c56)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:33.816201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1167/2355] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:33.831479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:33.998626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288c96ea5c054780a96e83f94b3b5c56'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:33.999378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288c96ea5c054780a96e83f94b3b5c56'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:34.000007 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288c96ea5c054780a96e83f94b3b5c56'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:34.069102 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288c96ea5c054780a96e83f94b3b5c56'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:34.116501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-61f40821-83c7-441f-9113-f39eebc0aeb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288c96ea5c054780a96e83f94b3b5c56'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:34.176474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da89ba-b20f-4514-ad69-0c025ab37318 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:34.179276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f1da89ba-b20f-4514-ad69-0c025ab37318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:34.207615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1189/2356] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:33 2022] DELETE /identity/v3/users/288c96ea5c054780a96e83f94b3b5c56 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:34.213004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faff61-9a7c-4332-9db5-aed14b58e311 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:34.216318 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faff61-9a7c-4332-9db5-aed14b58e311 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:34.217018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faff61-9a7c-4332-9db5-aed14b58e311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:34.299078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-73faff61-9a7c-4332-9db5-aed14b58e311 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:34.303092 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-73faff61-9a7c-4332-9db5-aed14b58e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:34.373421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da89ba-b20f-4514-ad69-0c025ab37318 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:34.510790 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdefb07-3af5-4273-bf83-ec6fc772cb1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:34.512094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdefb07-3af5-4273-bf83-ec6fc772cb1e service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:34.512436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdefb07-3af5-4273-bf83-ec6fc772cb1e service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:34.512967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdefb07-3af5-4273-bf83-ec6fc772cb1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:34.525520 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9fdefb07-3af5-4273-bf83-ec6fc772cb1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:34.559970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1190/2357] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:34.602652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faff61-9a7c-4332-9db5-aed14b58e311 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:34.609876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-73faff61-9a7c-4332-9db5-aed14b58e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:34.762301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdefb07-3af5-4273-bf83-ec6fc772cb1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:34.764488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdefb07-3af5-4273-bf83-ec6fc772cb1e service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:34.796474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1168/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:34.889688 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faff61-9a7c-4332-9db5-aed14b58e311 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:34.912602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fe0c4-ef7c-4231-8583-5ae85d1bc45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:34.913292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe0c4-ef7c-4231-8583-5ae85d1bc45b service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:34.914048 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe0c4-ef7c-4231-8583-5ae85d1bc45b service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:34.914333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fe0c4-ef7c-4231-8583-5ae85d1bc45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:34.955074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fe0c4-ef7c-4231-8583-5ae85d1bc45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:34.961867 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fe0c4-ef7c-4231-8583-5ae85d1bc45b service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:34.985023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1191/2359] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:35.026717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdefb07-3af5-4273-bf83-ec6fc772cb1e service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:35.028474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9fdefb07-3af5-4273-bf83-ec6fc772cb1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:35.060132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdefb07-3af5-4273-bf83-ec6fc772cb1e service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:35.078823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:35.081462 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:35.082275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:35.082766 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] PATH_INFO: `/v3/projects/e6fe8489397f4142954f3bd45f73cc80` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:35.100843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6fe8489397f4142954f3bd45f73cc80)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:35.110266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:35.294762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6fe8489397f4142954f3bd45f73cc80', 'request_id': 'req-d204eabd-a565-470c-875f-1c8730f652f0'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:35.302285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6fe8489397f4142954f3bd45f73cc80', 'request_id': 'req-d204eabd-a565-470c-875f-1c8730f652f0'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:35.315306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6fe8489397f4142954f3bd45f73cc80', 'request_id': 'req-d204eabd-a565-470c-875f-1c8730f652f0'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:35.347407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] The token cache is being invalidate because project e6fe8489397f4142954f3bd45f73cc80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:35.347873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:35.349902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:35.350739 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fe0c4-ef7c-4231-8583-5ae85d1bc45b service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:35.352590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f20fe0c4-ef7c-4231-8583-5ae85d1bc45b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:35.357347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1169/2360] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:35 2022] DELETE /identity/v3/projects/e6fe8489397f4142954f3bd45f73cc80 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:35.361724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:35.364445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:35.401742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fe0c4-ef7c-4231-8583-5ae85d1bc45b service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:35.517514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204eabd-a565-470c-875f-1c8730f652f0 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:35.524453 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:35.526996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:35.527363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:35.529997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] PATH_INFO: `/v3/users/98f70d4e57da4fe883b646f382729774` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:35.534028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f70d4e57da4fe883b646f382729774)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:35.536772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:35.557809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3032-6d4a-4c43-b89b-9503bddd6387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:35.559534 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3032-6d4a-4c43-b89b-9503bddd6387 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:35.560378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3032-6d4a-4c43-b89b-9503bddd6387 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:35.560855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3032-6d4a-4c43-b89b-9503bddd6387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:35.564606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-984c3032-6d4a-4c43-b89b-9503bddd6387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:35.619586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f70d4e57da4fe883b646f382729774'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:35.620389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f70d4e57da4fe883b646f382729774'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:35.621091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f70d4e57da4fe883b646f382729774'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:35.629077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f70d4e57da4fe883b646f382729774'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:35.655312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f70d4e57da4fe883b646f382729774'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:35.687568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1170/2361] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:35 2022] DELETE /identity/v3/users/98f70d4e57da4fe883b646f382729774 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:35.713123 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c3032-6d4a-4c43-b89b-9503bddd6387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:35.715951 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c3032-6d4a-4c43-b89b-9503bddd6387 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:35.733436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1192/2362] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:36.210460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:36.217463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:36.402138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcf510-64f1-4eae-81e4-97f1e8a4a3a7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:36.419559 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:36.421018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:36.421488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:36.422393 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] PATH_INFO: `/v3/projects/81ec27a8126e43e7bb04c8a566793cab` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:36.440395 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ec27a8126e43e7bb04c8a566793cab)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:36.450001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:36.643669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ec27a8126e43e7bb04c8a566793cab', 'request_id': 'req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:36.657361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ec27a8126e43e7bb04c8a566793cab', 'request_id': 'req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:36.694954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ec27a8126e43e7bb04c8a566793cab', 'request_id': 'req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:36.838659 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] The token cache is being invalidate because project 81ec27a8126e43e7bb04c8a566793cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:36.839067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:36.846750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:36.848971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1171/2363] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:36 2022] DELETE /identity/v3/projects/81ec27a8126e43e7bb04c8a566793cab => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:36.889171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3032-6d4a-4c43-b89b-9503bddd6387 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:36.925200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3032-6d4a-4c43-b89b-9503bddd6387 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:37.201504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:37.204356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:37.227973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:37.229595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:37.230117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:37.230622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] PATH_INFO: `/v3/projects/5db74a9c269d4ef686f7455e7516c12e` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:37.241807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db74a9c269d4ef686f7455e7516c12e)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:37.246436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:37.449181 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db74a9c269d4ef686f7455e7516c12e', 'request_id': 'req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:37.460091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db74a9c269d4ef686f7455e7516c12e', 'request_id': 'req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:37.477757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bfeb15-8a28-42b0-b762-c5edfe0dcc9f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:37.482611 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db74a9c269d4ef686f7455e7516c12e', 'request_id': 'req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:37.517073 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] The token cache is being invalidate because project 5db74a9c269d4ef686f7455e7516c12e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:37.517543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:37.518346 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-5ce3ae6b-3525-4e34-86f3-a78b8d8f6fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:37.527002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1193/2364] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:36 2022] DELETE /identity/v3/projects/5db74a9c269d4ef686f7455e7516c12e => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:37.528738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982e9d-2622-45de-902b-1188aef78094 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:37.529150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982e9d-2622-45de-902b-1188aef78094 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:37.529709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982e9d-2622-45de-902b-1188aef78094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:37.560051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-f2982e9d-2622-45de-902b-1188aef78094 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:37.561928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f2982e9d-2622-45de-902b-1188aef78094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:37.647305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93905e04-136e-4e2d-9a99-e72fb13a907e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:37.648421 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905e04-136e-4e2d-9a99-e72fb13a907e service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:37.649098 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905e04-136e-4e2d-9a99-e72fb13a907e service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:37.649478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93905e04-136e-4e2d-9a99-e72fb13a907e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:37.655433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-93905e04-136e-4e2d-9a99-e72fb13a907e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:37.713089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1194/2365] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:37.721931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b072c90-3424-4652-8530-0ca5107bc687 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:37.722214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b072c90-3424-4652-8530-0ca5107bc687 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:37.722562 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b072c90-3424-4652-8530-0ca5107bc687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:37.754899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-7b072c90-3424-4652-8530-0ca5107bc687 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:37.756176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7b072c90-3424-4652-8530-0ca5107bc687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:37.778487 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1195/2366] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:37.783473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b072c90-3424-4652-8530-0ca5107bc687 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:37.803936 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b072c90-3424-4652-8530-0ca5107bc687 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:37.817219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baff25-7673-449f-a673-b88d702b9734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:37.817943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baff25-7673-449f-a673-b88d702b9734 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:37.818214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baff25-7673-449f-a673-b88d702b9734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:37.818491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baff25-7673-449f-a673-b88d702b9734 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:37.819233 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baff25-7673-449f-a673-b88d702b9734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:37.819543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baff25-7673-449f-a673-b88d702b9734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:37.820657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93905e04-136e-4e2d-9a99-e72fb13a907e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:37.821179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baff25-7673-449f-a673-b88d702b9734 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:37.822363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93905e04-136e-4e2d-9a99-e72fb13a907e service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:37.850586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1196/2367] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:37.850911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1172/2368] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:37.851576 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baff25-7673-449f-a673-b88d702b9734 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:37.873264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baff25-7673-449f-a673-b88d702b9734 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:37.897735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75dc25-477e-40f6-bd55-4a6042b53fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:37.898541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75dc25-477e-40f6-bd55-4a6042b53fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:37.898744 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75dc25-477e-40f6-bd55-4a6042b53fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:37.899024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75dc25-477e-40f6-bd55-4a6042b53fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:37.900396 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75dc25-477e-40f6-bd55-4a6042b53fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:37.908828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75dc25-477e-40f6-bd55-4a6042b53fd1 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:37.992420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1197/2369] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:37 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:37.997009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93905e04-136e-4e2d-9a99-e72fb13a907e service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:38.013459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93905e04-136e-4e2d-9a99-e72fb13a907e service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:38.197617 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9a4d-a6df-4356-93a6-a7f0b25e5343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:38.198668 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9a4d-a6df-4356-93a6-a7f0b25e5343 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:38.198981 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9a4d-a6df-4356-93a6-a7f0b25e5343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:38.199510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9a4d-a6df-4356-93a6-a7f0b25e5343 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:38.200525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9a4d-a6df-4356-93a6-a7f0b25e5343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:38.203141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a9a4d-a6df-4356-93a6-a7f0b25e5343 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:38.238772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1173/2370] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:37 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:56:38.245005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75dc25-477e-40f6-bd55-4a6042b53fd1 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:38.262095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75dc25-477e-40f6-bd55-4a6042b53fd1 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:38.277273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913c3cf-7564-4768-9220-ebcd3ab16a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:38.278152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913c3cf-7564-4768-9220-ebcd3ab16a56 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:38.278482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913c3cf-7564-4768-9220-ebcd3ab16a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:38.278764 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913c3cf-7564-4768-9220-ebcd3ab16a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:38.279516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913c3cf-7564-4768-9220-ebcd3ab16a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:38.289226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913c3cf-7564-4768-9220-ebcd3ab16a56 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:38.335830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1198/2371] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:38.337870 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9a4d-a6df-4356-93a6-a7f0b25e5343 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:38.357174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9a4d-a6df-4356-93a6-a7f0b25e5343 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:38.381331 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800d49b-24d9-4e14-94c5-1bcbd4bcb5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:38.382076 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800d49b-24d9-4e14-94c5-1bcbd4bcb5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:38.384103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800d49b-24d9-4e14-94c5-1bcbd4bcb5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:38.384471 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800d49b-24d9-4e14-94c5-1bcbd4bcb5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:38.385252 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800d49b-24d9-4e14-94c5-1bcbd4bcb5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:38.394243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800d49b-24d9-4e14-94c5-1bcbd4bcb5e6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:38.417857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1174/2372] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:38.422519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913c3cf-7564-4768-9220-ebcd3ab16a56 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:38.442012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913c3cf-7564-4768-9220-ebcd3ab16a56 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:38.467805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a9432-1384-471c-bd00-0b4704e420a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:38.470101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a9432-1384-471c-bd00-0b4704e420a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:38.471047 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a9432-1384-471c-bd00-0b4704e420a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:38.472956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a9432-1384-471c-bd00-0b4704e420a2 admin admin] PATH_INFO: `/v3/projects/9389bf37e49f4571b103a3da55d65957/users/f0c842b0845e49d9b6cd43a7ea4b3c31/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:38.534247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a9432-1384-471c-bd00-0b4704e420a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9389bf37e49f4571b103a3da55d65957, user_id=f0c842b0845e49d9b6cd43a7ea4b3c31, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:38.537523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a9432-1384-471c-bd00-0b4704e420a2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:38.568952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1199/2373] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:38 2022] PUT /identity/v3/projects/9389bf37e49f4571b103a3da55d65957/users/f0c842b0845e49d9b6cd43a7ea4b3c31/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:56:38.593554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda7158-7e83-4646-ac7b-9780d5a20593 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:38.594536 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda7158-7e83-4646-ac7b-9780d5a20593 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:38.595052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda7158-7e83-4646-ac7b-9780d5a20593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:38.651505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-cbda7158-7e83-4646-ac7b-9780d5a20593 None None] MFA Rules not processed for user `f0c842b0845e49d9b6cd43a7ea4b3c31`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:38.653180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-cbda7158-7e83-4646-ac7b-9780d5a20593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:39.022041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1175/2374] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:39.049495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a9432-1384-471c-bd00-0b4704e420a2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:39.052219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f85a9432-1384-471c-bd00-0b4704e420a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:39.185921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a9432-1384-471c-bd00-0b4704e420a2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:39.199518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4d562-cdb7-4159-95fc-e615c0f09680 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7330a81c0f3a496ea29ae911fcc69221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:39.200186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4d562-cdb7-4159-95fc-e615c0f09680 service glance] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:39.200654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4d562-cdb7-4159-95fc-e615c0f09680 service glance] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:39.201087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4d562-cdb7-4159-95fc-e615c0f09680 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:39.215783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4d562-cdb7-4159-95fc-e615c0f09680 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:39.216995 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4d562-cdb7-4159-95fc-e615c0f09680 service glance] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:39.261498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1200/2375] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:44.002739 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda7158-7e83-4646-ac7b-9780d5a20593 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:44.004221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-cbda7158-7e83-4646-ac7b-9780d5a20593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:44.145172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57ab4b-ce29-4b51-9ccd-c863c48bb2e4 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:44.146060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57ab4b-ce29-4b51-9ccd-c863c48bb2e4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:44.146060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57ab4b-ce29-4b51-9ccd-c863c48bb2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:44.172794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda7158-7e83-4646-ac7b-9780d5a20593 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:44.197514 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:44.198587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:44.198856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:44.203236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] PATH_INFO: `/v3/users/64730ae538b145708eb4e1edf36fea36` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:44.206808 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64730ae538b145708eb4e1edf36fea36)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:44.209783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:44.223494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5d57ab4b-ce29-4b51-9ccd-c863c48bb2e4 None None] MFA Rules not processed for user `88f8874ff4194925960c748e01ede56b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:44.225403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5d57ab4b-ce29-4b51-9ccd-c863c48bb2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:44.352004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64730ae538b145708eb4e1edf36fea36'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:44.354845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64730ae538b145708eb4e1edf36fea36'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:44.356705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64730ae538b145708eb4e1edf36fea36'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:44.376181 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64730ae538b145708eb4e1edf36fea36'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:44.413173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64730ae538b145708eb4e1edf36fea36'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:44.460780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1201/2376] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:44.465669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1176/2377] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:44 2022] DELETE /identity/v3/users/64730ae538b145708eb4e1edf36fea36 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:44.467906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8b7a-4c71-4816-a54f-46ccaf3e00e5 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:44.468316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8b7a-4c71-4816-a54f-46ccaf3e00e5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:44.468697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af8b7a-4c71-4816-a54f-46ccaf3e00e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:44.481755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:44.487685 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:44.535107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-75af8b7a-4c71-4816-a54f-46ccaf3e00e5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:44.543478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-75af8b7a-4c71-4816-a54f-46ccaf3e00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:44.832117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef3552-9d1f-49d7-8638-063cd7f17fe2 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:44.845202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1202/2378] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:44.869851 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5472690-0f81-44bf-9880-beffa5eb5c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:44.870660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5472690-0f81-44bf-9880-beffa5eb5c15 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:44.870956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5472690-0f81-44bf-9880-beffa5eb5c15 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:44.871243 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5472690-0f81-44bf-9880-beffa5eb5c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:44.877954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d5472690-0f81-44bf-9880-beffa5eb5c15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:44.934021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af8b7a-4c71-4816-a54f-46ccaf3e00e5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:44.936214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-75af8b7a-4c71-4816-a54f-46ccaf3e00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:45.021259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5472690-0f81-44bf-9880-beffa5eb5c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:45.026169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5472690-0f81-44bf-9880-beffa5eb5c15 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:45.039167 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1177/2379] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:45.042046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af8b7a-4c71-4816-a54f-46ccaf3e00e5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:45.047678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ed71-335b-49c9-815c-2deab21825f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:45.048655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ed71-335b-49c9-815c-2deab21825f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:45.049090 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ed71-335b-49c9-815c-2deab21825f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:45.049692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ed71-335b-49c9-815c-2deab21825f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:45.067756 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7ed71-335b-49c9-815c-2deab21825f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:45.067756 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7ed71-335b-49c9-815c-2deab21825f7 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:45.082280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1203/2380] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:56:46.544402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5472690-0f81-44bf-9880-beffa5eb5c15 service nova] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:46.548053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d5472690-0f81-44bf-9880-beffa5eb5c15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:46.607067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5472690-0f81-44bf-9880-beffa5eb5c15 service nova] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:46.635116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:46.649386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:46.650414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:46.653186 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] PATH_INFO: `/v3/projects/cc16db8075164e4aa4e7b3346b7e260b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:46.672468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc16db8075164e4aa4e7b3346b7e260b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:46.678788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:46.866509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc16db8075164e4aa4e7b3346b7e260b', 'request_id': 'req-0fa672a7-7cd7-4e7a-9266-9cba488af896'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:46.887240 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc16db8075164e4aa4e7b3346b7e260b', 'request_id': 'req-0fa672a7-7cd7-4e7a-9266-9cba488af896'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:46.910479 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc16db8075164e4aa4e7b3346b7e260b', 'request_id': 'req-0fa672a7-7cd7-4e7a-9266-9cba488af896'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:46.934768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] The token cache is being invalidate because project cc16db8075164e4aa4e7b3346b7e260b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:46.938848 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:46.941247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:46.948837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1178/2381] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:46 2022] DELETE /identity/v3/projects/cc16db8075164e4aa4e7b3346b7e260b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:46.955981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ed71-335b-49c9-815c-2deab21825f7 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:46.968813 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ed71-335b-49c9-815c-2deab21825f7 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:47.084244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:47.085077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:47.085368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:47.085685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] PATH_INFO: `/v3/users/1b68b0a95b254433a6a018fee3cb8e51` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:47.089386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b68b0a95b254433a6a018fee3cb8e51)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:47.091417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:47.222154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b68b0a95b254433a6a018fee3cb8e51'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:47.223013 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b68b0a95b254433a6a018fee3cb8e51'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:47.224555 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b68b0a95b254433a6a018fee3cb8e51'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:47.246837 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b68b0a95b254433a6a018fee3cb8e51'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:47.271514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b68b0a95b254433a6a018fee3cb8e51'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:47.319525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1204/2382] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:46 2022] DELETE /identity/v3/users/1b68b0a95b254433a6a018fee3cb8e51 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:47.941344 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:47.942974 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:47.971098 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa672a7-7cd7-4e7a-9266-9cba488af896 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:48.091743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:48.093672 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:48.094312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:48.094956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] PATH_INFO: `/v3/projects/f672c3abb592408e9aacf94c12a17485` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:48.100031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f672c3abb592408e9aacf94c12a17485)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:48.106884 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:48.311003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f672c3abb592408e9aacf94c12a17485', 'request_id': 'req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:48.324121 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f672c3abb592408e9aacf94c12a17485', 'request_id': 'req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:48.352203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f672c3abb592408e9aacf94c12a17485', 'request_id': 'req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:48.394475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] The token cache is being invalidate because project f672c3abb592408e9aacf94c12a17485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:48.394773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:48.395608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:48.397413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1179/2383] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:47 2022] DELETE /identity/v3/projects/f672c3abb592408e9aacf94c12a17485 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:56:48.403723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:48.410009 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:48.437030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483476a-d177-4be6-a243-7fd338c8162a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:48.607911 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:48.610974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:48.611561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:48.613219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] PATH_INFO: `/v3/users/d31addf0dbe14529936b5300bab81216` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:48.616422 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31addf0dbe14529936b5300bab81216)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:48.625263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:48.849031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31addf0dbe14529936b5300bab81216'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:48.851589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31addf0dbe14529936b5300bab81216'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:48.853000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31addf0dbe14529936b5300bab81216'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:48.885236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31addf0dbe14529936b5300bab81216'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:48.905003 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-d0ce571f-d5fe-49f6-b71c-669cd2d31c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31addf0dbe14529936b5300bab81216'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:48.938386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1205/2384] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:48 2022] DELETE /identity/v3/users/d31addf0dbe14529936b5300bab81216 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:49.566089 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:49.567605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:49.597811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d53b57-87e3-4f6f-9fa3-b3aa1d958008 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:49.740972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:49.741856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:49.742337 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:49.743321 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] PATH_INFO: `/v3/projects/161158cc9e5b4027bf6d0bcc3dcc9d17` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:49.744670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] RBAC: Authorizing `identity:delete_project(project_id=161158cc9e5b4027bf6d0bcc3dcc9d17)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:49.747458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:49.865728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161158cc9e5b4027bf6d0bcc3dcc9d17', 'request_id': 'req-1b531e44-76ad-488b-a5a3-a5850ab2107e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:49.875905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161158cc9e5b4027bf6d0bcc3dcc9d17', 'request_id': 'req-1b531e44-76ad-488b-a5a3-a5850ab2107e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:49.888195 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161158cc9e5b4027bf6d0bcc3dcc9d17', 'request_id': 'req-1b531e44-76ad-488b-a5a3-a5850ab2107e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:49.920399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] The token cache is being invalidate because project 161158cc9e5b4027bf6d0bcc3dcc9d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:49.921060 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:49.925554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1b531e44-76ad-488b-a5a3-a5850ab2107e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:49.933499 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1180/2385] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:49 2022] DELETE /identity/v3/projects/161158cc9e5b4027bf6d0bcc3dcc9d17 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:49.938662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0337c4e-0b43-499c-bb31-dfb42b728604 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:49.939211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0337c4e-0b43-499c-bb31-dfb42b728604 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:49.939211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0337c4e-0b43-499c-bb31-dfb42b728604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:49.964971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-f0337c4e-0b43-499c-bb31-dfb42b728604 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:49.966563 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f0337c4e-0b43-499c-bb31-dfb42b728604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:50.093683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1206/2386] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:50.095384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e5daf-e2eb-479b-82a4-6f13165b8957 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:50.095680 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e5daf-e2eb-479b-82a4-6f13165b8957 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:50.095966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e5daf-e2eb-479b-82a4-6f13165b8957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:50.116714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-8c2e5daf-e2eb-479b-82a4-6f13165b8957 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:50.118324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8c2e5daf-e2eb-479b-82a4-6f13165b8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:50.129258 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1181/2387] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:50.134119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0337c4e-0b43-499c-bb31-dfb42b728604 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:50.152851 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0337c4e-0b43-499c-bb31-dfb42b728604 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:50.163684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600124-e012-46c6-a94c-73dcc6f3a483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:50.166375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600124-e012-46c6-a94c-73dcc6f3a483 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:50.166665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600124-e012-46c6-a94c-73dcc6f3a483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:50.166945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2600124-e012-46c6-a94c-73dcc6f3a483 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:50.168650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2600124-e012-46c6-a94c-73dcc6f3a483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:50.169118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2600124-e012-46c6-a94c-73dcc6f3a483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:50.172152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2600124-e012-46c6-a94c-73dcc6f3a483 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:50.193345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1207/2388] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:56:50.193603 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e5daf-e2eb-479b-82a4-6f13165b8957 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:50.206154 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e5daf-e2eb-479b-82a4-6f13165b8957 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:50.219689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d44ae-c601-414d-a325-eef0633d0127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:50.220468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d44ae-c601-414d-a325-eef0633d0127 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:50.220944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d44ae-c601-414d-a325-eef0633d0127 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:50.221527 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d44ae-c601-414d-a325-eef0633d0127 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:50.222621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d44ae-c601-414d-a325-eef0633d0127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:50.225191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d44ae-c601-414d-a325-eef0633d0127 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:50.265983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1182/2389] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:50 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:56:50.270125 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600124-e012-46c6-a94c-73dcc6f3a483 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:50.292665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2600124-e012-46c6-a94c-73dcc6f3a483 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:50.374138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e3a86-800f-426f-91d0-cc3301a9cb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:50.374874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e3a86-800f-426f-91d0-cc3301a9cb16 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:50.375163 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e3a86-800f-426f-91d0-cc3301a9cb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:50.375446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e3a86-800f-426f-91d0-cc3301a9cb16 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:50.376182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e3a86-800f-426f-91d0-cc3301a9cb16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:50.378271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e3a86-800f-426f-91d0-cc3301a9cb16 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:50.414035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1208/2390] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:50 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:50.416357 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d44ae-c601-414d-a325-eef0633d0127 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:50.433431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d44ae-c601-414d-a325-eef0633d0127 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:50.442628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639de10-e727-4ef5-add2-7feda40d3cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:50.443348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639de10-e727-4ef5-add2-7feda40d3cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:50.443646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639de10-e727-4ef5-add2-7feda40d3cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:50.443931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639de10-e727-4ef5-add2-7feda40d3cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:50.444752 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639de10-e727-4ef5-add2-7feda40d3cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:50.447791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639de10-e727-4ef5-add2-7feda40d3cb7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:50.464029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1183/2391] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:56:50.468408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e3a86-800f-426f-91d0-cc3301a9cb16 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:50.479079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e3a86-800f-426f-91d0-cc3301a9cb16 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:50.484212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1175b52-b9c6-4943-872c-6b65fecdf589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:50.484974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175b52-b9c6-4943-872c-6b65fecdf589 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:50.485264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175b52-b9c6-4943-872c-6b65fecdf589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:50.485541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1175b52-b9c6-4943-872c-6b65fecdf589 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:50.486344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1175b52-b9c6-4943-872c-6b65fecdf589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:50.488105 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1175b52-b9c6-4943-872c-6b65fecdf589 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:50.500829 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1209/2392] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:50.505430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639de10-e727-4ef5-add2-7feda40d3cb7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:50.517063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639de10-e727-4ef5-add2-7feda40d3cb7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:50.526931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2057-5348-4767-a54b-c2ada60c76c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:50.527843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2057-5348-4767-a54b-c2ada60c76c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:50.528125 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2057-5348-4767-a54b-c2ada60c76c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:50.528400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2057-5348-4767-a54b-c2ada60c76c7 admin admin] PATH_INFO: `/v3/projects/2e130ef227084e5c98dade60a598009b/users/05d0fe7502a240298d55c7f0dd8ac7d3/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:50.559249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a2057-5348-4767-a54b-c2ada60c76c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e130ef227084e5c98dade60a598009b, user_id=05d0fe7502a240298d55c7f0dd8ac7d3, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:50.564535 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a2057-5348-4767-a54b-c2ada60c76c7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:50.582097 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1184/2393] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:50 2022] PUT /identity/v3/projects/2e130ef227084e5c98dade60a598009b/users/05d0fe7502a240298d55c7f0dd8ac7d3/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:50.604005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa7885-71b4-4b83-ad7b-6e7a44bb731c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:50.604475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa7885-71b4-4b83-ad7b-6e7a44bb731c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:50.604931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa7885-71b4-4b83-ad7b-6e7a44bb731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:50.653259 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-83aa7885-71b4-4b83-ad7b-6e7a44bb731c None None] MFA Rules not processed for user `05d0fe7502a240298d55c7f0dd8ac7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:50.654737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-83aa7885-71b4-4b83-ad7b-6e7a44bb731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:50.797000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1210/2394] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:50.811703 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2057-5348-4767-a54b-c2ada60c76c7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:50.814533 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-323a2057-5348-4767-a54b-c2ada60c76c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:50.913036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2057-5348-4767-a54b-c2ada60c76c7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:50.918043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922035c-c2fc-4520-a5ee-1a083d24bd1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:50.919055 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922035c-c2fc-4520-a5ee-1a083d24bd1c service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:50.919405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922035c-c2fc-4520-a5ee-1a083d24bd1c service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:50.919719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922035c-c2fc-4520-a5ee-1a083d24bd1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:50.929207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922035c-c2fc-4520-a5ee-1a083d24bd1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:50.931275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922035c-c2fc-4520-a5ee-1a083d24bd1c service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:50.941439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1185/2395] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:56:53.341517 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa7885-71b4-4b83-ad7b-6e7a44bb731c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:53.349714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-83aa7885-71b4-4b83-ad7b-6e7a44bb731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:53.594626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa7885-71b4-4b83-ad7b-6e7a44bb731c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:53.600312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:53.601369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:53.601764 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:53.602302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] PATH_INFO: `/v3/users/5638166fc1894aeba29c5a0317d00249` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:53.604597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5638166fc1894aeba29c5a0317d00249)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:53.606996 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:53.695270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5638166fc1894aeba29c5a0317d00249'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:53.696437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5638166fc1894aeba29c5a0317d00249'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:53.697063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5638166fc1894aeba29c5a0317d00249'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:53.715822 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5638166fc1894aeba29c5a0317d00249'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:53.730023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5638166fc1894aeba29c5a0317d00249'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:53.755881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1211/2396] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:53 2022] DELETE /identity/v3/users/5638166fc1894aeba29c5a0317d00249 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:53.995030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922035c-c2fc-4520-a5ee-1a083d24bd1c service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:54.036227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922035c-c2fc-4520-a5ee-1a083d24bd1c service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:54.143063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:54.144521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:54.145035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:54.145538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] PATH_INFO: `/v3/projects/c485fb8280a9452093556972a276f787` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:54.147870 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c485fb8280a9452093556972a276f787)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:54.152246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:54.222922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c485fb8280a9452093556972a276f787', 'request_id': 'req-7105da40-542b-4f61-b264-5c7cb59fd273'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:54.229825 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c485fb8280a9452093556972a276f787', 'request_id': 'req-7105da40-542b-4f61-b264-5c7cb59fd273'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:54.239203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c485fb8280a9452093556972a276f787', 'request_id': 'req-7105da40-542b-4f61-b264-5c7cb59fd273'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:54.260829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] The token cache is being invalidate because project c485fb8280a9452093556972a276f787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:54.261320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:54.262502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:54.265256 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1186/2397] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:53 2022] DELETE /identity/v3/projects/c485fb8280a9452093556972a276f787 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:54.270943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:54.272975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:54.287644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee519c-d31a-43da-a7e9-2d1e7f13bf2a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:54.387359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:54.388992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:54.389517 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:54.390087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] PATH_INFO: `/v3/users/763b183f89294a2ea3bcc81b56a3990f` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:54.392449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=763b183f89294a2ea3bcc81b56a3990f)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:54.396719 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:54.468153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763b183f89294a2ea3bcc81b56a3990f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:54.468854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763b183f89294a2ea3bcc81b56a3990f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:54.469810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763b183f89294a2ea3bcc81b56a3990f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:54.491508 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763b183f89294a2ea3bcc81b56a3990f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:54.504053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-b5652da1-56d0-41be-bd82-c30e8701ab14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763b183f89294a2ea3bcc81b56a3990f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:54.526006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1212/2398] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:56:54 2022] DELETE /identity/v3/users/763b183f89294a2ea3bcc81b56a3990f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:54.810520 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:54.812595 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:54.838281 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105da40-542b-4f61-b264-5c7cb59fd273 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:54.944954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:54.946967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:54.947435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:54.947918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] PATH_INFO: `/v3/projects/e89cb9102f6243ffbb577ae034ab6a7f` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:54.950296 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e89cb9102f6243ffbb577ae034ab6a7f)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:54.954320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:55.027142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e89cb9102f6243ffbb577ae034ab6a7f', 'request_id': 'req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:55.034423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e89cb9102f6243ffbb577ae034ab6a7f', 'request_id': 'req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:55.045285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e89cb9102f6243ffbb577ae034ab6a7f', 'request_id': 'req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:55.060162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] The token cache is being invalidate because project e89cb9102f6243ffbb577ae034ab6a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:56:55.060678 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:55.061798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0c0c3e7-1845-42eb-aa47-d93b3bf85ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:56:55.064236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1187/2399] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:56:54 2022] DELETE /identity/v3/projects/e89cb9102f6243ffbb577ae034ab6a7f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:55.072599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff87e20-860a-4027-8c06-d6a4341e8ef1 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:55.073079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff87e20-860a-4027-8c06-d6a4341e8ef1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:55.073612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff87e20-860a-4027-8c06-d6a4341e8ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:55.163454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-8ff87e20-860a-4027-8c06-d6a4341e8ef1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:55.165808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8ff87e20-860a-4027-8c06-d6a4341e8ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:55.231457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1213/2400] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:56:55.239873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e568e-95d0-44bb-b130-a65679e26f9b None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:55.240161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e568e-95d0-44bb-b130-a65679e26f9b None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:55.240442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e568e-95d0-44bb-b130-a65679e26f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:55.268978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-4b2e568e-95d0-44bb-b130-a65679e26f9b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:55.271226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4b2e568e-95d0-44bb-b130-a65679e26f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:55.286515 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1188/2401] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:55.291200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff87e20-860a-4027-8c06-d6a4341e8ef1 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:55.301924 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff87e20-860a-4027-8c06-d6a4341e8ef1 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:55.307490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7513987-ee16-4144-b625-55d9f2846d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:55.308178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7513987-ee16-4144-b625-55d9f2846d0b admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:55.308462 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7513987-ee16-4144-b625-55d9f2846d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:55.308735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7513987-ee16-4144-b625-55d9f2846d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:55.309488 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7513987-ee16-4144-b625-55d9f2846d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:56:55.309844 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7513987-ee16-4144-b625-55d9f2846d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:55.311613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7513987-ee16-4144-b625-55d9f2846d0b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:55.329757 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1214/2402] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:56:55.339522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e568e-95d0-44bb-b130-a65679e26f9b None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:55.354398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e568e-95d0-44bb-b130-a65679e26f9b None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:55.360484 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6e38-f43a-4f5c-9062-cf45d32e5bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:55.361173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6e38-f43a-4f5c-9062-cf45d32e5bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:55.361451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6e38-f43a-4f5c-9062-cf45d32e5bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:55.361770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6e38-f43a-4f5c-9062-cf45d32e5bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:55.362478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e6e38-f43a-4f5c-9062-cf45d32e5bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:55.364452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e6e38-f43a-4f5c-9062-cf45d32e5bb4 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:55.395537 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1189/2403] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:56:55 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:55.401138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7513987-ee16-4144-b625-55d9f2846d0b admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:55.412300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7513987-ee16-4144-b625-55d9f2846d0b admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:55.473389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dfd9e-f5b7-4c96-9e1a-af83b19edbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:55.474100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dfd9e-f5b7-4c96-9e1a-af83b19edbe2 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:55.474388 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dfd9e-f5b7-4c96-9e1a-af83b19edbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:55.474671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555dfd9e-f5b7-4c96-9e1a-af83b19edbe2 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:55.475365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dfd9e-f5b7-4c96-9e1a-af83b19edbe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:55.478174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555dfd9e-f5b7-4c96-9e1a-af83b19edbe2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:55.501612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1215/2404] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:56:55 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:56:55.505307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6e38-f43a-4f5c-9062-cf45d32e5bb4 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:55.516547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6e38-f43a-4f5c-9062-cf45d32e5bb4 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:55.522134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267f24b-300a-43c0-bfa7-58963cfdccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:55.522930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267f24b-300a-43c0-bfa7-58963cfdccfe admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:55.523282 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267f24b-300a-43c0-bfa7-58963cfdccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:55.523615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267f24b-300a-43c0-bfa7-58963cfdccfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:55.525658 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267f24b-300a-43c0-bfa7-58963cfdccfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:55.527402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267f24b-300a-43c0-bfa7-58963cfdccfe admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:55.538531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1190/2405] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:56:55.544508 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dfd9e-f5b7-4c96-9e1a-af83b19edbe2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:55.557172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555dfd9e-f5b7-4c96-9e1a-af83b19edbe2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:55.562300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3a70f-7c81-4ae4-9e8b-417ba6dfe090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:55.563017 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a70f-7c81-4ae4-9e8b-417ba6dfe090 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:55.563342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a70f-7c81-4ae4-9e8b-417ba6dfe090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:55.563657 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3a70f-7c81-4ae4-9e8b-417ba6dfe090 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:55.564433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a70f-7c81-4ae4-9e8b-417ba6dfe090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:55.566226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3a70f-7c81-4ae4-9e8b-417ba6dfe090 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:55.577565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1216/2406] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:56:55.582028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267f24b-300a-43c0-bfa7-58963cfdccfe admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:55.593460 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267f24b-300a-43c0-bfa7-58963cfdccfe admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:55.598213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ecef-5ff7-4f31-9622-62c7a9d048e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:55.599104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ecef-5ff7-4f31-9622-62c7a9d048e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:55.599428 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ecef-5ff7-4f31-9622-62c7a9d048e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:55.599664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ecef-5ff7-4f31-9622-62c7a9d048e3 admin admin] PATH_INFO: `/v3/projects/da442ca94eac4a288cd839c9ae0c621d/users/4075d0a94123490f896d8ef46e282ad2/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:55.616422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6ecef-5ff7-4f31-9622-62c7a9d048e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da442ca94eac4a288cd839c9ae0c621d, user_id=4075d0a94123490f896d8ef46e282ad2, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:55.619577 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6ecef-5ff7-4f31-9622-62c7a9d048e3 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:55.635979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1191/2407] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:56:55 2022] PUT /identity/v3/projects/da442ca94eac4a288cd839c9ae0c621d/users/4075d0a94123490f896d8ef46e282ad2/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:56:55.723843 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90e70b-19f1-45a5-bb65-35d8c27c6579 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:55.724202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90e70b-19f1-45a5-bb65-35d8c27c6579 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:55.724563 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90e70b-19f1-45a5-bb65-35d8c27c6579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:55.753870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-df90e70b-19f1-45a5-bb65-35d8c27c6579 None None] MFA Rules not processed for user `4075d0a94123490f896d8ef46e282ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:56:55.755140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-df90e70b-19f1-45a5-bb65-35d8c27c6579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:55.871759 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1217/2408] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:56:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:56:55.880477 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ecef-5ff7-4f31-9622-62c7a9d048e3 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:56:55.882435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-82c6ecef-5ff7-4f31-9622-62c7a9d048e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:56:55.984397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ecef-5ff7-4f31-9622-62c7a9d048e3 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:56:55.990769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ca307-07b2-4d2b-a3dd-f4585b83ed72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:56:55.992302 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca307-07b2-4d2b-a3dd-f4585b83ed72 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:56:55.993257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca307-07b2-4d2b-a3dd-f4585b83ed72 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:56:55.994534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ca307-07b2-4d2b-a3dd-f4585b83ed72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:56:56.005052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca307-07b2-4d2b-a3dd-f4585b83ed72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:56:56.006956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ca307-07b2-4d2b-a3dd-f4585b83ed72 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:56:56.019482 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1192/2409] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:56:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:57:01.655505 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90e70b-19f1-45a5-bb65-35d8c27c6579 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:01.735372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90e70b-19f1-45a5-bb65-35d8c27c6579 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:01.740625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:01.741531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:01.741845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:01.742116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] PATH_INFO: `/v3/users/4075d0a94123490f896d8ef46e282ad2` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:01.743480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4075d0a94123490f896d8ef46e282ad2)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:01.746440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:01.837988 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4075d0a94123490f896d8ef46e282ad2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:01.838893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4075d0a94123490f896d8ef46e282ad2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:01.839926 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4075d0a94123490f896d8ef46e282ad2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:01.860265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4075d0a94123490f896d8ef46e282ad2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:01.872640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4075d0a94123490f896d8ef46e282ad2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:01.897504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1218/2410] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:57:01 2022] DELETE /identity/v3/users/4075d0a94123490f896d8ef46e282ad2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:57:01.903160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049a2dc-cbec-4ce8-9103-d3cd30f4e148 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:01.904020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049a2dc-cbec-4ce8-9103-d3cd30f4e148 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:01.904174 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049a2dc-cbec-4ce8-9103-d3cd30f4e148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:01.934132 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d049a2dc-cbec-4ce8-9103-d3cd30f4e148 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:01.935657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d049a2dc-cbec-4ce8-9103-d3cd30f4e148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:01.999647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1193/2411] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:02.010030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:02.011509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:02.095612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96d1b1-4bf5-46ad-b069-1b05d9ee1773 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:02.099530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c280bfe-6c7a-4054-8c77-590460e9f3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:02.100207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c280bfe-6c7a-4054-8c77-590460e9f3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:02.100489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c280bfe-6c7a-4054-8c77-590460e9f3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:02.100761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c280bfe-6c7a-4054-8c77-590460e9f3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:02.111586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c280bfe-6c7a-4054-8c77-590460e9f3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:02.113016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c280bfe-6c7a-4054-8c77-590460e9f3f1 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:02.124431 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1219/2412] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:57:02.428046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049a2dc-cbec-4ce8-9103-d3cd30f4e148 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:02.429479 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d049a2dc-cbec-4ce8-9103-d3cd30f4e148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:02.442058 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049a2dc-cbec-4ce8-9103-d3cd30f4e148 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:02.447837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:02.448622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:02.448971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:02.449171 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] PATH_INFO: `/v3/projects/da442ca94eac4a288cd839c9ae0c621d` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:02.450574 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da442ca94eac4a288cd839c9ae0c621d)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:02.453463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:02.507068 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da442ca94eac4a288cd839c9ae0c621d', 'request_id': 'req-10deb440-ba8d-4367-a2cf-ebab17f82b6e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:02.513507 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da442ca94eac4a288cd839c9ae0c621d', 'request_id': 'req-10deb440-ba8d-4367-a2cf-ebab17f82b6e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:02.521413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da442ca94eac4a288cd839c9ae0c621d', 'request_id': 'req-10deb440-ba8d-4367-a2cf-ebab17f82b6e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:02.534348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] The token cache is being invalidate because project da442ca94eac4a288cd839c9ae0c621d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:57:02.534832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:02.535614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-10deb440-ba8d-4367-a2cf-ebab17f82b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:02.537681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1194/2413] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:57:02 2022] DELETE /identity/v3/projects/da442ca94eac4a288cd839c9ae0c621d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:57:08.193133 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c280bfe-6c7a-4054-8c77-590460e9f3f1 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:08.196032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3c280bfe-6c7a-4054-8c77-590460e9f3f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:08.217301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c280bfe-6c7a-4054-8c77-590460e9f3f1 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:08.318703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:08.319637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:08.320016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:08.321915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] PATH_INFO: `/v3/users/f0c842b0845e49d9b6cd43a7ea4b3c31` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:08.323529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c842b0845e49d9b6cd43a7ea4b3c31)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:08.326265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:08.383453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c842b0845e49d9b6cd43a7ea4b3c31'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:08.384316 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c842b0845e49d9b6cd43a7ea4b3c31'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:08.385353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c842b0845e49d9b6cd43a7ea4b3c31'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:08.403178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c842b0845e49d9b6cd43a7ea4b3c31'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:08.412253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c842b0845e49d9b6cd43a7ea4b3c31'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:08.426826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1220/2414] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:57:08 2022] DELETE /identity/v3/users/f0c842b0845e49d9b6cd43a7ea4b3c31 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:57:08.431701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952698d-47ae-438f-9313-999f76113c75 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:08.432483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952698d-47ae-438f-9313-999f76113c75 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:08.432483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952698d-47ae-438f-9313-999f76113c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:08.451908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e952698d-47ae-438f-9313-999f76113c75 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:08.453151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e952698d-47ae-438f-9313-999f76113c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:08.515731 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1195/2415] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:57:08.526737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:08.528230 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:08.589821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e78184-a77e-4473-a846-30b8d6fed629 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:08.593650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdd3fa-494b-4024-a13b-6d282ddcea02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:08.594436 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd3fa-494b-4024-a13b-6d282ddcea02 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:08.594893 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd3fa-494b-4024-a13b-6d282ddcea02 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:08.595300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdd3fa-494b-4024-a13b-6d282ddcea02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:08.606345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdd3fa-494b-4024-a13b-6d282ddcea02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:08.609223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdd3fa-494b-4024-a13b-6d282ddcea02 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:08.627681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1221/2416] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:57:09.072453 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952698d-47ae-438f-9313-999f76113c75 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:09.080666 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e952698d-47ae-438f-9313-999f76113c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:09.112932 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952698d-47ae-438f-9313-999f76113c75 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:09.122537 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:09.124373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:09.124848 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:09.125589 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] PATH_INFO: `/v3/projects/9389bf37e49f4571b103a3da55d65957` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:09.138725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9389bf37e49f4571b103a3da55d65957)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:09.144989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:09.224165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9389bf37e49f4571b103a3da55d65957', 'request_id': 'req-e0e96c46-9150-4afb-9276-bbdca3c759ba'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:09.238082 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9389bf37e49f4571b103a3da55d65957', 'request_id': 'req-e0e96c46-9150-4afb-9276-bbdca3c759ba'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:09.254732 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9389bf37e49f4571b103a3da55d65957', 'request_id': 'req-e0e96c46-9150-4afb-9276-bbdca3c759ba'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:09.277881 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] The token cache is being invalidate because project 9389bf37e49f4571b103a3da55d65957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:57:09.278367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:09.280131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0e96c46-9150-4afb-9276-bbdca3c759ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:09.283173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1196/2417] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:57:09 2022] DELETE /identity/v3/projects/9389bf37e49f4571b103a3da55d65957 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:57:09.289857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758243-0064-4802-b212-d6849077010e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:09.290900 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758243-0064-4802-b212-d6849077010e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:09.291817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758243-0064-4802-b212-d6849077010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:09.315366 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-ce758243-0064-4802-b212-d6849077010e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:09.316594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-ce758243-0064-4802-b212-d6849077010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:09.388296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1222/2418] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:09.395922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bd4d-6499-4fdf-bd36-6cd7ede6090c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:09.396319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bd4d-6499-4fdf-bd36-6cd7ede6090c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:09.396690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691bd4d-6499-4fdf-bd36-6cd7ede6090c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:09.425077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f691bd4d-6499-4fdf-bd36-6cd7ede6090c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:09.426416 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f691bd4d-6499-4fdf-bd36-6cd7ede6090c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:09.435228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1197/2419] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:09.439845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758243-0064-4802-b212-d6849077010e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:09.450879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758243-0064-4802-b212-d6849077010e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:09.456360 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaf347-b9aa-4f89-a142-6e7cdb9fd346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:09.457085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaf347-b9aa-4f89-a142-6e7cdb9fd346 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:09.457410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaf347-b9aa-4f89-a142-6e7cdb9fd346 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:09.457815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaf347-b9aa-4f89-a142-6e7cdb9fd346 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:09.458668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaf347-b9aa-4f89-a142-6e7cdb9fd346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:57:09.459018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaf347-b9aa-4f89-a142-6e7cdb9fd346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:09.461389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaf347-b9aa-4f89-a142-6e7cdb9fd346 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:09.474683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1223/2420] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:57:09.480639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691bd4d-6499-4fdf-bd36-6cd7ede6090c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:09.496884 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691bd4d-6499-4fdf-bd36-6cd7ede6090c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:09.504347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c616-ba58-496e-bb84-6ba82b6d9efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:09.505420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c616-ba58-496e-bb84-6ba82b6d9efc admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:09.505937 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c616-ba58-496e-bb84-6ba82b6d9efc admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:09.506412 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6c616-ba58-496e-bb84-6ba82b6d9efc admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:09.508188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c616-ba58-496e-bb84-6ba82b6d9efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:09.511763 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6c616-ba58-496e-bb84-6ba82b6d9efc admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:09.553454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1198/2421] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:57:09 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:57:09.557015 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaf347-b9aa-4f89-a142-6e7cdb9fd346 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:09.568537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaf347-b9aa-4f89-a142-6e7cdb9fd346 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:09.639642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94adeee-f271-494c-9320-b7683bd143b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:09.640521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94adeee-f271-494c-9320-b7683bd143b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:09.640946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94adeee-f271-494c-9320-b7683bd143b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:09.641334 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94adeee-f271-494c-9320-b7683bd143b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:09.642499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94adeee-f271-494c-9320-b7683bd143b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:09.645546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94adeee-f271-494c-9320-b7683bd143b1 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:09.680325 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1224/2422] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:57:09 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:57:09.685773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c616-ba58-496e-bb84-6ba82b6d9efc admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:09.699624 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6c616-ba58-496e-bb84-6ba82b6d9efc admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:09.706648 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669947da-22d4-4f76-ab29-7599eee29483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:09.707653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669947da-22d4-4f76-ab29-7599eee29483 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:09.708190 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669947da-22d4-4f76-ab29-7599eee29483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:09.708589 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669947da-22d4-4f76-ab29-7599eee29483 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:09.709529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669947da-22d4-4f76-ab29-7599eee29483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:09.711566 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669947da-22d4-4f76-ab29-7599eee29483 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:09.726899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1199/2423] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:57:09.731432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94adeee-f271-494c-9320-b7683bd143b1 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:09.742511 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94adeee-f271-494c-9320-b7683bd143b1 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:09.748009 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e323c4-9432-4475-9e6b-8440e1773a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:09.748688 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e323c4-9432-4475-9e6b-8440e1773a6d admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:09.748973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e323c4-9432-4475-9e6b-8440e1773a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:09.749255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e323c4-9432-4475-9e6b-8440e1773a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:09.750162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e323c4-9432-4475-9e6b-8440e1773a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:09.751779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e323c4-9432-4475-9e6b-8440e1773a6d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:09.763680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1225/2424] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 12:57:09.769724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669947da-22d4-4f76-ab29-7599eee29483 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:09.784190 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669947da-22d4-4f76-ab29-7599eee29483 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:09.793497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f1297-d29a-4e85-b57d-7f8b73321835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:09.795063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1297-d29a-4e85-b57d-7f8b73321835 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:09.795555 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1297-d29a-4e85-b57d-7f8b73321835 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:09.796055 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f1297-d29a-4e85-b57d-7f8b73321835 admin admin] PATH_INFO: `/v3/projects/57f626fcebcc41859770213d3646b6bf/users/f6a411897a0946269b22af65f78b8e86/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:09.822524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f1297-d29a-4e85-b57d-7f8b73321835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f626fcebcc41859770213d3646b6bf, user_id=f6a411897a0946269b22af65f78b8e86, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:09.827908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f1297-d29a-4e85-b57d-7f8b73321835 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:09.848117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1200/2425] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:57:09 2022] PUT /identity/v3/projects/57f626fcebcc41859770213d3646b6bf/users/f6a411897a0946269b22af65f78b8e86/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:57:09.853876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c472-5676-4f16-8e0a-f0612e04df6b None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:09.854189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c472-5676-4f16-8e0a-f0612e04df6b None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:09.854445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94c472-5676-4f16-8e0a-f0612e04df6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:09.873271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-db94c472-5676-4f16-8e0a-f0612e04df6b None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:09.874537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-db94c472-5676-4f16-8e0a-f0612e04df6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:09.944581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1226/2426] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:09.972511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f1297-d29a-4e85-b57d-7f8b73321835 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:09.975416 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-752f1297-d29a-4e85-b57d-7f8b73321835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:10.066997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f1297-d29a-4e85-b57d-7f8b73321835 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:10.073118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051bedd-f384-4d53-8e7a-dc26cf6a69a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:10.074305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051bedd-f384-4d53-8e7a-dc26cf6a69a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:10.074840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051bedd-f384-4d53-8e7a-dc26cf6a69a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:10.075341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051bedd-f384-4d53-8e7a-dc26cf6a69a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:10.090657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051bedd-f384-4d53-8e7a-dc26cf6a69a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:10.092698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0051bedd-f384-4d53-8e7a-dc26cf6a69a1 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:10.116719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1201/2427] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:57:11.073086 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b441b7-d355-4eeb-ade4-073f222c44a8 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:11.073807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b441b7-d355-4eeb-ade4-073f222c44a8 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:11.074079 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b441b7-d355-4eeb-ade4-073f222c44a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:11.126125 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-49b441b7-d355-4eeb-ade4-073f222c44a8 None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:11.128192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-49b441b7-d355-4eeb-ade4-073f222c44a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:11.227906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1227/2428] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 12:57:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:11.286689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051bedd-f384-4d53-8e7a-dc26cf6a69a1 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:11.289364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0051bedd-f384-4d53-8e7a-dc26cf6a69a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:11.339704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b441b7-d355-4eeb-ade4-073f222c44a8 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:11.343224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-49b441b7-d355-4eeb-ade4-073f222c44a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:11.364135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b441b7-d355-4eeb-ade4-073f222c44a8 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:11.371966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:11.373986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:11.374480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:11.375158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] PATH_INFO: `/v3/users/05d0fe7502a240298d55c7f0dd8ac7d3` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:11.378033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d0fe7502a240298d55c7f0dd8ac7d3)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:11.384189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:11.406235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051bedd-f384-4d53-8e7a-dc26cf6a69a1 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:11.412829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891710c-882c-4ff2-a59e-f8ff192db0a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:11.414099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891710c-882c-4ff2-a59e-f8ff192db0a1 service swift] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:11.414099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891710c-882c-4ff2-a59e-f8ff192db0a1 service swift] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:11.414423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891710c-882c-4ff2-a59e-f8ff192db0a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:11.441491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891710c-882c-4ff2-a59e-f8ff192db0a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:11.443812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891710c-882c-4ff2-a59e-f8ff192db0a1 service swift] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:11.466576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1202/2429] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 12:57:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 12:57:11.494172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d0fe7502a240298d55c7f0dd8ac7d3'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:11.495154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d0fe7502a240298d55c7f0dd8ac7d3'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:11.505755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d0fe7502a240298d55c7f0dd8ac7d3'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:11.507433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd57a8f-de27-443a-ab4e-11ac6bb5a658 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:11.508461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd57a8f-de27-443a-ab4e-11ac6bb5a658 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:11.509110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd57a8f-de27-443a-ab4e-11ac6bb5a658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:11.524362 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d0fe7502a240298d55c7f0dd8ac7d3'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:11.539601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-08180eae-a602-4c29-9301-9c949725b663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d0fe7502a240298d55c7f0dd8ac7d3'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:11.560553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1228/2430] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:57:11 2022] DELETE /identity/v3/users/05d0fe7502a240298d55c7f0dd8ac7d3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:57:11.565076 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455586-197d-4249-af92-b560bd7926a1 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:11.565685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455586-197d-4249-af92-b560bd7926a1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:11.566285 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455586-197d-4249-af92-b560bd7926a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:11.582836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-0dd57a8f-de27-443a-ab4e-11ac6bb5a658 None None] MFA Rules not processed for user `f6a411897a0946269b22af65f78b8e86`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:11.584793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0dd57a8f-de27-443a-ab4e-11ac6bb5a658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:11.591853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-7e455586-197d-4249-af92-b560bd7926a1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:11.594373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7e455586-197d-4249-af92-b560bd7926a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:11.676336 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1203/2431] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:11.695522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd57a8f-de27-443a-ab4e-11ac6bb5a658 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:11.698279 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0dd57a8f-de27-443a-ab4e-11ac6bb5a658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:11.718717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1229/2432] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:57:11.728342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e455586-197d-4249-af92-b560bd7926a1 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:11.733336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7e455586-197d-4249-af92-b560bd7926a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:11.912955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd57a8f-de27-443a-ab4e-11ac6bb5a658 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:11.924013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6d3de-3d34-45a9-8a41-bb9c23353355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:11.925334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6d3de-3d34-45a9-8a41-bb9c23353355 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:11.926008 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6d3de-3d34-45a9-8a41-bb9c23353355 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:11.926623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6d3de-3d34-45a9-8a41-bb9c23353355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:11.953064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6d3de-3d34-45a9-8a41-bb9c23353355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:11.953495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e455586-197d-4249-af92-b560bd7926a1 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:11.956367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6d3de-3d34-45a9-8a41-bb9c23353355 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:11.973748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cb289-17d2-4c18-904a-de168e800e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:11.974816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cb289-17d2-4c18-904a-de168e800e95 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:11.975391 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cb289-17d2-4c18-904a-de168e800e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:11.976888 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9cb289-17d2-4c18-904a-de168e800e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:12.017535 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1204/2433] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:57:12.048107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cb289-17d2-4c18-904a-de168e800e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:12.058142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9cb289-17d2-4c18-904a-de168e800e95 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:12.102508 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1230/2434] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:57:12.875521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c099a4e-7b68-44cb-8bc8-08117be27be7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:12.876554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c099a4e-7b68-44cb-8bc8-08117be27be7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:12.876554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c099a4e-7b68-44cb-8bc8-08117be27be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:12.905462 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cb289-17d2-4c18-904a-de168e800e95 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:12.907044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bc9cb289-17d2-4c18-904a-de168e800e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:12.946494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-7c099a4e-7b68-44cb-8bc8-08117be27be7 None None] MFA Rules not processed for user `ef623fa30c4647e18d9dd3f81704e0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:12.947356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9cb289-17d2-4c18-904a-de168e800e95 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:12.952388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7c099a4e-7b68-44cb-8bc8-08117be27be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:12.972244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:12.974018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:12.974552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:12.975001 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] PATH_INFO: `/v3/projects/2e130ef227084e5c98dade60a598009b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:12.978294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e130ef227084e5c98dade60a598009b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:12.982153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:13.075314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e130ef227084e5c98dade60a598009b', 'request_id': 'req-873fe892-899f-4ad8-90b7-e588f637ef48'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:13.087967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1205/2435] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:57:13.088241 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e130ef227084e5c98dade60a598009b', 'request_id': 'req-873fe892-899f-4ad8-90b7-e588f637ef48'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:13.104381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e130ef227084e5c98dade60a598009b', 'request_id': 'req-873fe892-899f-4ad8-90b7-e588f637ef48'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:13.125857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] The token cache is being invalidate because project 2e130ef227084e5c98dade60a598009b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:57:13.126650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:13.127994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-873fe892-899f-4ad8-90b7-e588f637ef48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:57:13.131331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1231/2436] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:57:12 2022] DELETE /identity/v3/projects/2e130ef227084e5c98dade60a598009b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:57:13.140584 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f43318-e037-4b50-ab08-b88fe40e469a None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:13.143542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f43318-e037-4b50-ab08-b88fe40e469a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:13.144546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f43318-e037-4b50-ab08-b88fe40e469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:13.178780 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-71f43318-e037-4b50-ab08-b88fe40e469a None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:13.181811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-71f43318-e037-4b50-ab08-b88fe40e469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:13.386405 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1206/2437] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:13.389283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543495c1-e169-459c-b5fd-8849727307ac None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:13.390412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543495c1-e169-459c-b5fd-8849727307ac None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:13.390976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543495c1-e169-459c-b5fd-8849727307ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:13.442044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-543495c1-e169-459c-b5fd-8849727307ac None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:13.444386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-543495c1-e169-459c-b5fd-8849727307ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:13.465630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1232/2438] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:13.477354 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f43318-e037-4b50-ab08-b88fe40e469a None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:13.503912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f43318-e037-4b50-ab08-b88fe40e469a None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:13.521361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8185d-6f74-456b-9b0c-70a340ba70ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:13.522511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8185d-6f74-456b-9b0c-70a340ba70ce admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:13.523284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8185d-6f74-456b-9b0c-70a340ba70ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:13.523796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8185d-6f74-456b-9b0c-70a340ba70ce admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:13.525632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8185d-6f74-456b-9b0c-70a340ba70ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:57:13.526009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8185d-6f74-456b-9b0c-70a340ba70ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:13.528057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8185d-6f74-456b-9b0c-70a340ba70ce admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:13.548199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1207/2439] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 12:57:13.553634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543495c1-e169-459c-b5fd-8849727307ac None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:13.567489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543495c1-e169-459c-b5fd-8849727307ac None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:13.583367 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31188f-ff6f-40bc-b430-867af40cfd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:13.584531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31188f-ff6f-40bc-b430-867af40cfd0a admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:13.584998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31188f-ff6f-40bc-b430-867af40cfd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:13.585459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31188f-ff6f-40bc-b430-867af40cfd0a admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:13.586723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31188f-ff6f-40bc-b430-867af40cfd0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:13.591234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31188f-ff6f-40bc-b430-867af40cfd0a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:13.631659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1233/2440] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:57:13 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:57:13.638348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8185d-6f74-456b-9b0c-70a340ba70ce admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:13.659810 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8185d-6f74-456b-9b0c-70a340ba70ce admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:13.735771 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b705ac2-a0c8-4aba-aab1-40e7c52d133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:13.736591 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705ac2-a0c8-4aba-aab1-40e7c52d133e admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:13.737246 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705ac2-a0c8-4aba-aab1-40e7c52d133e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:13.737610 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705ac2-a0c8-4aba-aab1-40e7c52d133e admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:13.738580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b705ac2-a0c8-4aba-aab1-40e7c52d133e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:13.743566 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b705ac2-a0c8-4aba-aab1-40e7c52d133e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:13.842022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1208/2441] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:57:13 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:57:13.842494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31188f-ff6f-40bc-b430-867af40cfd0a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:13.849670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31188f-ff6f-40bc-b430-867af40cfd0a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:13.862857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f30231-5e28-4736-9094-77946e34238e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:13.864139 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f30231-5e28-4736-9094-77946e34238e admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:13.864726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f30231-5e28-4736-9094-77946e34238e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:13.865205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f30231-5e28-4736-9094-77946e34238e admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:13.867375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f30231-5e28-4736-9094-77946e34238e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:13.870884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f30231-5e28-4736-9094-77946e34238e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:13.903301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1234/2442] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:57:13.907437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b705ac2-a0c8-4aba-aab1-40e7c52d133e admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:13.934855 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b705ac2-a0c8-4aba-aab1-40e7c52d133e admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:13.941348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81973393-eeb4-49f7-a196-32148eda15e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:13.942760 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81973393-eeb4-49f7-a196-32148eda15e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:13.943053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81973393-eeb4-49f7-a196-32148eda15e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:13.943339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81973393-eeb4-49f7-a196-32148eda15e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:13.944201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81973393-eeb4-49f7-a196-32148eda15e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:13.947737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81973393-eeb4-49f7-a196-32148eda15e6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:13.966238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1209/2443] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:57:13.970798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f30231-5e28-4736-9094-77946e34238e admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:13.984740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f30231-5e28-4736-9094-77946e34238e admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:13.990076 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dea22f-fecb-48c4-9fd6-cd3a041e371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:13.990999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dea22f-fecb-48c4-9fd6-cd3a041e371e admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:13.991277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dea22f-fecb-48c4-9fd6-cd3a041e371e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:13.991560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dea22f-fecb-48c4-9fd6-cd3a041e371e admin admin] PATH_INFO: `/v3/projects/876780e50b1845259edd80270e3cb845/users/ded8b3214eb047d4a1f580c4453a1f42/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:13.997801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd19eb-3053-4923-85e3-7964e748b56d None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:13.998126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd19eb-3053-4923-85e3-7964e748b56d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:13.998447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd19eb-3053-4923-85e3-7964e748b56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:14.009794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dea22f-fecb-48c4-9fd6-cd3a041e371e admin admin] RBAC: Authorizing `identity:create_grant(project_id=876780e50b1845259edd80270e3cb845, user_id=ded8b3214eb047d4a1f580c4453a1f42, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:14.012538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dea22f-fecb-48c4-9fd6-cd3a041e371e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:14.019833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e2dd19eb-3053-4923-85e3-7964e748b56d None None] MFA Rules not processed for user `f6a411897a0946269b22af65f78b8e86`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:14.021398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e2dd19eb-3053-4923-85e3-7964e748b56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:14.039437 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1235/2444] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:57:13 2022] PUT /identity/v3/projects/876780e50b1845259edd80270e3cb845/users/ded8b3214eb047d4a1f580c4453a1f42/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 12:57:14.046130 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3004b-8544-4b76-8fbc-a27b5f07feb7 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:14.046415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3004b-8544-4b76-8fbc-a27b5f07feb7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:14.046761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3004b-8544-4b76-8fbc-a27b5f07feb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:14.068423 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-05e3004b-8544-4b76-8fbc-a27b5f07feb7 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:14.070186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-05e3004b-8544-4b76-8fbc-a27b5f07feb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:14.159639 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1236/2445] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:14.162175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3004b-8544-4b76-8fbc-a27b5f07feb7 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:14.165117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-05e3004b-8544-4b76-8fbc-a27b5f07feb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:14.223150 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1210/2446] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:57:14.403708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3004b-8544-4b76-8fbc-a27b5f07feb7 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:14.407832 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa129c-f813-45e4-b862-2daeec0a1d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:14.408614 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa129c-f813-45e4-b862-2daeec0a1d9f service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:14.408971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa129c-f813-45e4-b862-2daeec0a1d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:14.409319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa129c-f813-45e4-b862-2daeec0a1d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:14.422184 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa129c-f813-45e4-b862-2daeec0a1d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:14.423965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa129c-f813-45e4-b862-2daeec0a1d9f service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:14.443020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1237/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:57:23.795290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1733-ec59-4d6a-af09-767e1a93281a None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:23.796184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1733-ec59-4d6a-af09-767e1a93281a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:23.796184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c1733-ec59-4d6a-af09-767e1a93281a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:23.832026 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-145c1733-ec59-4d6a-af09-767e1a93281a None None] MFA Rules not processed for user `c9e498e3dae54ffab54d93958bfc2ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:23.833293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-145c1733-ec59-4d6a-af09-767e1a93281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:24.052649 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1211/2448] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:26.876307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad293de-b30a-4c2e-b458-6639c194319c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:26.877155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad293de-b30a-4c2e-b458-6639c194319c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:26.877155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad293de-b30a-4c2e-b458-6639c194319c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:26.960036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2ad293de-b30a-4c2e-b458-6639c194319c None None] MFA Rules not processed for user `ded8b3214eb047d4a1f580c4453a1f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:26.966486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2ad293de-b30a-4c2e-b458-6639c194319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:27.222889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1238/2449] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:57:27.224166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c1733-ec59-4d6a-af09-767e1a93281a None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:27.245729 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c1733-ec59-4d6a-af09-767e1a93281a None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:27.273954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43fe01-c640-4555-9f70-5564539ea1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:27.278375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43fe01-c640-4555-9f70-5564539ea1fe admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:27.279893 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43fe01-c640-4555-9f70-5564539ea1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:27.281268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43fe01-c640-4555-9f70-5564539ea1fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:27.282636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43fe01-c640-4555-9f70-5564539ea1fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:27.297598 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43fe01-c640-4555-9f70-5564539ea1fe admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:27.403977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1212/2450] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:57:27 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 12:57:27.408356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad293de-b30a-4c2e-b458-6639c194319c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:27.425516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad293de-b30a-4c2e-b458-6639c194319c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:27.571762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd7910-1c91-431f-8468-2b4af2e36410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:27.572721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7910-1c91-431f-8468-2b4af2e36410 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:27.573157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7910-1c91-431f-8468-2b4af2e36410 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:27.573623 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7910-1c91-431f-8468-2b4af2e36410 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:27.575261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd7910-1c91-431f-8468-2b4af2e36410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:27.578443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd7910-1c91-431f-8468-2b4af2e36410 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:27.633264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1239/2451] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:57:27 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:57:27.633994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43fe01-c640-4555-9f70-5564539ea1fe admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:27.676207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43fe01-c640-4555-9f70-5564539ea1fe admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:27.696334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6b94e-8968-46cb-8344-2e814f7aed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:27.697311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6b94e-8968-46cb-8344-2e814f7aed57 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:27.697783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6b94e-8968-46cb-8344-2e814f7aed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:27.698260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6b94e-8968-46cb-8344-2e814f7aed57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:27.701088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6b94e-8968-46cb-8344-2e814f7aed57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:27.703549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6b94e-8968-46cb-8344-2e814f7aed57 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:27.732865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1213/2452] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:57:27.740686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd7910-1c91-431f-8468-2b4af2e36410 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:27.760740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd7910-1c91-431f-8468-2b4af2e36410 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:27.774132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b46cea-19a2-40b0-a358-ca5d2c5b30cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:27.774132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b46cea-19a2-40b0-a358-ca5d2c5b30cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:27.774132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b46cea-19a2-40b0-a358-ca5d2c5b30cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:27.774132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b46cea-19a2-40b0-a358-ca5d2c5b30cf admin admin] PATH_INFO: `/v3/projects/2ac1ca9b7c1c4652b1bf47d2b0a11092/users/78754dd72c484170b410f352771484e0/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:27.815202 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b46cea-19a2-40b0-a358-ca5d2c5b30cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac1ca9b7c1c4652b1bf47d2b0a11092, user_id=78754dd72c484170b410f352771484e0, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:27.820443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b46cea-19a2-40b0-a358-ca5d2c5b30cf admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:27.841642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1240/2453] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:57:27 2022] PUT /identity/v3/projects/2ac1ca9b7c1c4652b1bf47d2b0a11092/users/78754dd72c484170b410f352771484e0/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:57:27.847827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6b94e-8968-46cb-8344-2e814f7aed57 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:27.867339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6b94e-8968-46cb-8344-2e814f7aed57 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:27.992782 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798f8e1-94ac-4c94-a496-042bcfd9dbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:27.993924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798f8e1-94ac-4c94-a496-042bcfd9dbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:27.994224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798f8e1-94ac-4c94-a496-042bcfd9dbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:27.994510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798f8e1-94ac-4c94-a496-042bcfd9dbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:27.995335 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798f8e1-94ac-4c94-a496-042bcfd9dbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:27.998997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798f8e1-94ac-4c94-a496-042bcfd9dbb7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:28.024365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1214/2454] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:57:28.028380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b46cea-19a2-40b0-a358-ca5d2c5b30cf admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:28.061355 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b46cea-19a2-40b0-a358-ca5d2c5b30cf admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:28.084556 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c2a13-ad1e-45e9-a527-614a0230cb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:28.086695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c2a13-ad1e-45e9-a527-614a0230cb69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:28.087093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c2a13-ad1e-45e9-a527-614a0230cb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:28.087540 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c2a13-ad1e-45e9-a527-614a0230cb69 admin admin] PATH_INFO: `/v3/projects/2ac1ca9b7c1c4652b1bf47d2b0a11092/users/78754dd72c484170b410f352771484e0/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:28.090566 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c2a13-ad1e-45e9-a527-614a0230cb69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac1ca9b7c1c4652b1bf47d2b0a11092, user_id=78754dd72c484170b410f352771484e0, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:28.097957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c2a13-ad1e-45e9-a527-614a0230cb69 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:28.124220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1241/2455] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:57:28 2022] PUT /identity/v3/projects/2ac1ca9b7c1c4652b1bf47d2b0a11092/users/78754dd72c484170b410f352771484e0/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:57:40.870212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920315a-8281-470d-93db-68be217162ff None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:40.870856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920315a-8281-470d-93db-68be217162ff None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:40.870856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920315a-8281-470d-93db-68be217162ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:40.900837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c920315a-8281-470d-93db-68be217162ff None None] MFA Rules not processed for user `78754dd72c484170b410f352771484e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:40.902519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c920315a-8281-470d-93db-68be217162ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:40.982976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1215/2456] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:41.009187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c2a13-ad1e-45e9-a527-614a0230cb69 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:41.013338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6f6c2a13-ad1e-45e9-a527-614a0230cb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:41.184419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c2a13-ad1e-45e9-a527-614a0230cb69 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:41.195574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5651ee-bb6f-4767-92b1-59be3663e57a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:41.197399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5651ee-bb6f-4767-92b1-59be3663e57a service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:41.197399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5651ee-bb6f-4767-92b1-59be3663e57a service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:41.197399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5651ee-bb6f-4767-92b1-59be3663e57a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:41.356255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5651ee-bb6f-4767-92b1-59be3663e57a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:41.363825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5651ee-bb6f-4767-92b1-59be3663e57a service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:41.393758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1242/2457] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:57:43.257563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920315a-8281-470d-93db-68be217162ff None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:43.259088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c920315a-8281-470d-93db-68be217162ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:43.358367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920315a-8281-470d-93db-68be217162ff None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:43.363185 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239dbe4-2dc3-4b40-89ed-6842b704eaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:43.364684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239dbe4-2dc3-4b40-89ed-6842b704eaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:43.365192 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239dbe4-2dc3-4b40-89ed-6842b704eaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:43.366751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239dbe4-2dc3-4b40-89ed-6842b704eaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:43.369675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b239dbe4-2dc3-4b40-89ed-6842b704eaa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:43.595677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239dbe4-2dc3-4b40-89ed-6842b704eaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:43.597791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239dbe4-2dc3-4b40-89ed-6842b704eaa1 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:43.624922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1216/2458] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:57:43.874720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88db926-fbb0-44df-b560-4bcf6acd112a None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:43.876531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88db926-fbb0-44df-b560-4bcf6acd112a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:43.877343 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88db926-fbb0-44df-b560-4bcf6acd112a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:43.924512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d88db926-fbb0-44df-b560-4bcf6acd112a None None] MFA Rules not processed for user `ded8b3214eb047d4a1f580c4453a1f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:43.926074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d88db926-fbb0-44df-b560-4bcf6acd112a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:43.942483 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1243/2459] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:46.605752 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc51cd-2e71-4734-9ebe-4c1bcc253a83 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:46.607125 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc51cd-2e71-4734-9ebe-4c1bcc253a83 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:46.614375 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc51cd-2e71-4734-9ebe-4c1bcc253a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:46.668399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-32dc51cd-2e71-4734-9ebe-4c1bcc253a83 None None] MFA Rules not processed for user `f6a411897a0946269b22af65f78b8e86`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:46.670971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-32dc51cd-2e71-4734-9ebe-4c1bcc253a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:46.825306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1217/2460] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:47.495593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659ca4-a68f-43f3-8422-490835d90f90 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:47.496463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659ca4-a68f-43f3-8422-490835d90f90 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:47.496463 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09659ca4-a68f-43f3-8422-490835d90f90 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:47.497640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1244/2461] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 12:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 12:57:47.508331 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27274b-3e99-4005-8b20-5c0dc96e5b80 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:47.509025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27274b-3e99-4005-8b20-5c0dc96e5b80 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:47.509518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27274b-3e99-4005-8b20-5c0dc96e5b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:47.559901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-ab27274b-3e99-4005-8b20-5c0dc96e5b80 None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:47.561516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ab27274b-3e99-4005-8b20-5c0dc96e5b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:47.573425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1218/2462] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:47.586784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09659ca4-a68f-43f3-8422-490835d90f90 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:47.589526 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-09659ca4-a68f-43f3-8422-490835d90f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:47.696502 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09659ca4-a68f-43f3-8422-490835d90f90 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:47.700170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c52cd-ea40-44e3-966c-4336a27a8969 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7330a81c0f3a496ea29ae911fcc69221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:47.700838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c52cd-ea40-44e3-966c-4336a27a8969 service glance] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:47.701137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c52cd-ea40-44e3-966c-4336a27a8969 service glance] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:47.701418 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c52cd-ea40-44e3-966c-4336a27a8969 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:47.713557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c52cd-ea40-44e3-966c-4336a27a8969 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:47.715070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c52cd-ea40-44e3-966c-4336a27a8969 service glance] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:47.734606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1245/2463] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:57:47.823793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc2933-d81b-46e4-8d8f-b3e15a0f77f4 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:47.824782 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc2933-d81b-46e4-8d8f-b3e15a0f77f4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:47.825062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc2933-d81b-46e4-8d8f-b3e15a0f77f4 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:47.826914 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1219/2464] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 12:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:57:47.835720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439b371-6671-4af5-bb23-7f22e89bafe7 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:47.835968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439b371-6671-4af5-bb23-7f22e89bafe7 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:47.836477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439b371-6671-4af5-bb23-7f22e89bafe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:47.892400 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-1439b371-6671-4af5-bb23-7f22e89bafe7 None None] MFA Rules not processed for user `7bd327cdfe2c4f729252d86838aae638`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:47.894064 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1439b371-6671-4af5-bb23-7f22e89bafe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:47.903279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1246/2465] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 12:57:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:47.973444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc2933-d81b-46e4-8d8f-b3e15a0f77f4 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:47.985412 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc2933-d81b-46e4-8d8f-b3e15a0f77f4 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:47.989324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d563832b-3e98-4626-a547-df2d20cdabbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:47.990031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563832b-3e98-4626-a547-df2d20cdabbf service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:47.990830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563832b-3e98-4626-a547-df2d20cdabbf service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:47.991344 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d563832b-3e98-4626-a547-df2d20cdabbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:48.000822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563832b-3e98-4626-a547-df2d20cdabbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:48.002687 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d563832b-3e98-4626-a547-df2d20cdabbf service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:48.030998 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1220/2466] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:57:48.473197 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d23331-5b4e-43d2-9032-63c7b79d6fd3 None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:48.474766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d23331-5b4e-43d2-9032-63c7b79d6fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:48.480459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d23331-5b4e-43d2-9032-63c7b79d6fd3 None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:48.482299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1247/2467] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 12:57:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 12:57:48.488736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c47c-aaa5-47e7-b12d-1cf5acbcc3fb None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:48.489485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c47c-aaa5-47e7-b12d-1cf5acbcc3fb None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:48.490813 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735c47c-aaa5-47e7-b12d-1cf5acbcc3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:48.520690 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f735c47c-aaa5-47e7-b12d-1cf5acbcc3fb None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:48.524699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f735c47c-aaa5-47e7-b12d-1cf5acbcc3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:48.539102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1221/2468] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 12:57:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:48.561498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d23331-5b4e-43d2-9032-63c7b79d6fd3 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:48.587785 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d23331-5b4e-43d2-9032-63c7b79d6fd3 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:48.597604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617ded3-c591-4e35-98c7-d43e51887884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:48.602118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617ded3-c591-4e35-98c7-d43e51887884 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:48.602728 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617ded3-c591-4e35-98c7-d43e51887884 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:48.603236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617ded3-c591-4e35-98c7-d43e51887884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:48.640440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617ded3-c591-4e35-98c7-d43e51887884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:48.642023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617ded3-c591-4e35-98c7-d43e51887884 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:48.655075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1248/2469] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:57:56.808970 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d185-1072-4dce-a497-9520b8c50e6a None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:56.809504 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d185-1072-4dce-a497-9520b8c50e6a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:56.809626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d185-1072-4dce-a497-9520b8c50e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:56.827862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-a082d185-1072-4dce-a497-9520b8c50e6a None None] MFA Rules not processed for user `00d5aeec35784bfb80b431605ef02a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:56.829080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a082d185-1072-4dce-a497-9520b8c50e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:56.896713 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1222/2470] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:57:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:58.093111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a04e-045d-4279-b761-164351abcb17 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:58.093886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a04e-045d-4279-b761-164351abcb17 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:58.093886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a04e-045d-4279-b761-164351abcb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:58.150070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-76d9a04e-045d-4279-b761-164351abcb17 None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:57:58.151540 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-76d9a04e-045d-4279-b761-164351abcb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:58.227042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1249/2471] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 12:57:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:57:58.240662 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082d185-1072-4dce-a497-9520b8c50e6a None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:58.242201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a082d185-1072-4dce-a497-9520b8c50e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:58.248663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9a04e-045d-4279-b761-164351abcb17 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:57:58.250354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-76d9a04e-045d-4279-b761-164351abcb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:58.346557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082d185-1072-4dce-a497-9520b8c50e6a None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:58.352485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ba0ae-b2d7-49bb-9cb7-214a3b9c1524 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:58.353157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ba0ae-b2d7-49bb-9cb7-214a3b9c1524 service swift] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:58.353435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ba0ae-b2d7-49bb-9cb7-214a3b9c1524 service swift] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:58.353756 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ba0ae-b2d7-49bb-9cb7-214a3b9c1524 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:58.362422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ba0ae-b2d7-49bb-9cb7-214a3b9c1524 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:58.363569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9a04e-045d-4279-b761-164351abcb17 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:57:58.364056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ba0ae-b2d7-49bb-9cb7-214a3b9c1524 service swift] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:58.369767 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876cf15-6c69-4494-9ce0-4916408eb592 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221dab3ebc4f4c68b253729391e9c503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:57:58.370734 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876cf15-6c69-4494-9ce0-4916408eb592 service placement] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:57:58.371184 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876cf15-6c69-4494-9ce0-4916408eb592 service placement] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:57:58.371473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876cf15-6c69-4494-9ce0-4916408eb592 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:57:58.373386 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c876cf15-6c69-4494-9ce0-4916408eb592 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:57:58.374219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1223/2472] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 12:57:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 12:57:58.386403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876cf15-6c69-4494-9ce0-4916408eb592 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:57:58.388038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876cf15-6c69-4494-9ce0-4916408eb592 service placement] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:57:58.400144 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1250/2473] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:57:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:58:23.101966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214996-d5f1-4932-b277-29d6f4096a27 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:23.102575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214996-d5f1-4932-b277-29d6f4096a27 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:23.102575 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0214996-d5f1-4932-b277-29d6f4096a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:23.122061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d0214996-d5f1-4932-b277-29d6f4096a27 None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:58:23.123301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d0214996-d5f1-4932-b277-29d6f4096a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:58:23.140519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1224/2474] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 12:58:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:58:23.167850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876cf15-6c69-4494-9ce0-4916408eb592 service placement] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:23.180056 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876cf15-6c69-4494-9ce0-4916408eb592 service placement] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:23.185644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66882573-b26a-4b86-b72a-b0707b34c805 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:23.186298 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66882573-b26a-4b86-b72a-b0707b34c805 service swift] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:23.187162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66882573-b26a-4b86-b72a-b0707b34c805 service swift] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:23.187162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66882573-b26a-4b86-b72a-b0707b34c805 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:23.197465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66882573-b26a-4b86-b72a-b0707b34c805 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:23.199099 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66882573-b26a-4b86-b72a-b0707b34c805 service swift] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:23.209080 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1251/2475] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 12:58:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 12:58:25.339087 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8fb0d-fd89-4a95-9aee-645cbfe6ff8c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:25.340876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8fb0d-fd89-4a95-9aee-645cbfe6ff8c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:25.341996 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8fb0d-fd89-4a95-9aee-645cbfe6ff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:25.368478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-82d8fb0d-fd89-4a95-9aee-645cbfe6ff8c None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:58:25.370023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-82d8fb0d-fd89-4a95-9aee-645cbfe6ff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:58:25.381978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1225/2476] 10.222.0.23 () {58 vars in 967 bytes} [Wed Apr 6 12:58:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:58:25.399745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66882573-b26a-4b86-b72a-b0707b34c805 service swift] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:25.414800 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66882573-b26a-4b86-b72a-b0707b34c805 service swift] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:25.423523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa720f9a-0eba-41e4-b8e7-a6e70cd11241 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:25.424331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720f9a-0eba-41e4-b8e7-a6e70cd11241 service swift] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:25.424768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720f9a-0eba-41e4-b8e7-a6e70cd11241 service swift] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:25.425198 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa720f9a-0eba-41e4-b8e7-a6e70cd11241 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:25.440636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa720f9a-0eba-41e4-b8e7-a6e70cd11241 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:25.443442 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa720f9a-0eba-41e4-b8e7-a6e70cd11241 service swift] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:25.452575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1252/2477] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 12:58:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 12:58:31.366389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8fb0d-fd89-4a95-9aee-645cbfe6ff8c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:31.383960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8fb0d-fd89-4a95-9aee-645cbfe6ff8c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:31.388182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b486a7a-cc55-4aa7-9378-d210d745aad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:31.389161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b486a7a-cc55-4aa7-9378-d210d745aad2 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:31.389519 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b486a7a-cc55-4aa7-9378-d210d745aad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:31.389919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b486a7a-cc55-4aa7-9378-d210d745aad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:31.400446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b486a7a-cc55-4aa7-9378-d210d745aad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:31.402065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b486a7a-cc55-4aa7-9378-d210d745aad2 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:31.412736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1226/2478] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:58:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:58:39.717525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963691-1fb4-4c1f-b7bb-cb23a9d44075 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:39.718022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963691-1fb4-4c1f-b7bb-cb23a9d44075 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:39.718112 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52963691-1fb4-4c1f-b7bb-cb23a9d44075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:39.734828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-52963691-1fb4-4c1f-b7bb-cb23a9d44075 None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:58:39.736038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-52963691-1fb4-4c1f-b7bb-cb23a9d44075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:58:39.743968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1253/2479] 10.222.0.23 () {58 vars in 967 bytes} [Wed Apr 6 12:58:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:58:39.757334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b486a7a-cc55-4aa7-9378-d210d745aad2 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:39.768386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b486a7a-cc55-4aa7-9378-d210d745aad2 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:39.773480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b684-fe77-44a7-afcf-7d3211e94185 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:39.774144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b684-fe77-44a7-afcf-7d3211e94185 service swift] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:39.774424 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b684-fe77-44a7-afcf-7d3211e94185 service swift] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:39.774696 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970b684-fe77-44a7-afcf-7d3211e94185 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:39.782837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970b684-fe77-44a7-afcf-7d3211e94185 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:39.784426 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970b684-fe77-44a7-afcf-7d3211e94185 service swift] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:39.792480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1227/2480] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 12:58:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 12:58:41.708628 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52963691-1fb4-4c1f-b7bb-cb23a9d44075 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:41.710206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-52963691-1fb4-4c1f-b7bb-cb23a9d44075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:58:41.777001 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52963691-1fb4-4c1f-b7bb-cb23a9d44075 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:41.781802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:41.782670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:41.782952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:41.783224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] PATH_INFO: `/v3/users/f6a411897a0946269b22af65f78b8e86` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:41.784418 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a411897a0946269b22af65f78b8e86)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:41.786380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:41.830995 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a411897a0946269b22af65f78b8e86'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:58:41.831602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a411897a0946269b22af65f78b8e86'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:58:41.832823 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a411897a0946269b22af65f78b8e86'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:58:41.844453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a411897a0946269b22af65f78b8e86'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:58:41.852367 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-58c2772b-15af-4e0a-9573-067d13f4934f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a411897a0946269b22af65f78b8e86'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:58:41.865726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1254/2481] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:58:41 2022] DELETE /identity/v3/users/f6a411897a0946269b22af65f78b8e86 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:58:42.037010 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b684-fe77-44a7-afcf-7d3211e94185 service swift] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:42.048632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970b684-fe77-44a7-afcf-7d3211e94185 service swift] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:42.117958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:42.118828 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.119106 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.119383 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] PATH_INFO: `/v3/projects/57f626fcebcc41859770213d3646b6bf` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.120552 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f626fcebcc41859770213d3646b6bf)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:42.122511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:42.167232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f626fcebcc41859770213d3646b6bf', 'request_id': 'req-4523b54b-eb65-4534-8c31-56e13a2d272a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:58:42.172328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f626fcebcc41859770213d3646b6bf', 'request_id': 'req-4523b54b-eb65-4534-8c31-56e13a2d272a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:58:42.180115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f626fcebcc41859770213d3646b6bf', 'request_id': 'req-4523b54b-eb65-4534-8c31-56e13a2d272a'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:58:42.190986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] The token cache is being invalidate because project 57f626fcebcc41859770213d3646b6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:58:42.191273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:58:42.191904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4523b54b-eb65-4534-8c31-56e13a2d272a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:58:42.193434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1228/2482] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:58:42 2022] DELETE /identity/v3/projects/57f626fcebcc41859770213d3646b6bf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:58:42.198350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6ac8a-d7eb-44c8-a16b-93cab05baaf4 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.198636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6ac8a-d7eb-44c8-a16b-93cab05baaf4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.198913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6ac8a-d7eb-44c8-a16b-93cab05baaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.216064 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-dcb6ac8a-d7eb-44c8-a16b-93cab05baaf4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:58:42.217259 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-dcb6ac8a-d7eb-44c8-a16b-93cab05baaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:58:42.275715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1255/2483] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:58:42.283995 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb8275-ec7b-469a-aa08-f520777abad6 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.284283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb8275-ec7b-469a-aa08-f520777abad6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.285048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb8275-ec7b-469a-aa08-f520777abad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.304988 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-9acb8275-ec7b-469a-aa08-f520777abad6 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:58:42.306266 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9acb8275-ec7b-469a-aa08-f520777abad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:58:42.314272 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1229/2484] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:58:42.319039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6ac8a-d7eb-44c8-a16b-93cab05baaf4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:42.332452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6ac8a-d7eb-44c8-a16b-93cab05baaf4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:42.337311 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab39f39-510b-422e-8baa-53b14f07f8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:42.338016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab39f39-510b-422e-8baa-53b14f07f8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.338297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab39f39-510b-422e-8baa-53b14f07f8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.338572 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab39f39-510b-422e-8baa-53b14f07f8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.339301 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab39f39-510b-422e-8baa-53b14f07f8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 12:58:42.339604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab39f39-510b-422e-8baa-53b14f07f8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:42.341210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab39f39-510b-422e-8baa-53b14f07f8a7 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:42.354335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1256/2485] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 12:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 12:58:42.358882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb8275-ec7b-469a-aa08-f520777abad6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:42.369168 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb8275-ec7b-469a-aa08-f520777abad6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:42.374223 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7c82b-13c2-4a6f-b293-499de59724f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:42.374877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7c82b-13c2-4a6f-b293-499de59724f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.375148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7c82b-13c2-4a6f-b293-499de59724f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.375414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7c82b-13c2-4a6f-b293-499de59724f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.376112 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7c82b-13c2-4a6f-b293-499de59724f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:42.378078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7c82b-13c2-4a6f-b293-499de59724f9 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:42.405134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1230/2486] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 12:58:42 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:58:42.409446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab39f39-510b-422e-8baa-53b14f07f8a7 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:42.422564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab39f39-510b-422e-8baa-53b14f07f8a7 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:42.492019 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd857b9-11d1-4794-8324-73fbe5f9a454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:42.492787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd857b9-11d1-4794-8324-73fbe5f9a454 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.493089 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd857b9-11d1-4794-8324-73fbe5f9a454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.493346 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd857b9-11d1-4794-8324-73fbe5f9a454 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.494077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd857b9-11d1-4794-8324-73fbe5f9a454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:42.496014 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd857b9-11d1-4794-8324-73fbe5f9a454 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:42.519574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1257/2487] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 12:58:42 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 12:58:42.523823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7c82b-13c2-4a6f-b293-499de59724f9 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:42.534356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7c82b-13c2-4a6f-b293-499de59724f9 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:42.540001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89378f0d-8b53-40dd-aaa1-c126ccc774dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:42.540692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89378f0d-8b53-40dd-aaa1-c126ccc774dc admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.540993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89378f0d-8b53-40dd-aaa1-c126ccc774dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.541293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89378f0d-8b53-40dd-aaa1-c126ccc774dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.542374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89378f0d-8b53-40dd-aaa1-c126ccc774dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:42.544104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89378f0d-8b53-40dd-aaa1-c126ccc774dc admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:42.555397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1231/2488] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:58:42.559522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd857b9-11d1-4794-8324-73fbe5f9a454 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:42.570366 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd857b9-11d1-4794-8324-73fbe5f9a454 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:42.575189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d313e63-cd4c-4da2-ae1f-ed2bf5768778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:42.575920 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313e63-cd4c-4da2-ae1f-ed2bf5768778 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.576206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313e63-cd4c-4da2-ae1f-ed2bf5768778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.576482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d313e63-cd4c-4da2-ae1f-ed2bf5768778 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.577211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d313e63-cd4c-4da2-ae1f-ed2bf5768778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:42.578865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d313e63-cd4c-4da2-ae1f-ed2bf5768778 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:42.590101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1258/2489] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 12:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 12:58:42.594212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89378f0d-8b53-40dd-aaa1-c126ccc774dc admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:42.605067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89378f0d-8b53-40dd-aaa1-c126ccc774dc admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:42.609939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c86ca-c788-4ab8-8ea0-0e004865dcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:42.610924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c86ca-c788-4ab8-8ea0-0e004865dcc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.611270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c86ca-c788-4ab8-8ea0-0e004865dcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.611645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c86ca-c788-4ab8-8ea0-0e004865dcc1 admin admin] PATH_INFO: `/v3/projects/4b71cb67854e429fa6088fd4ccf5d206/users/11da6d64e6d0449db4378ff5e3341743/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.628212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c86ca-c788-4ab8-8ea0-0e004865dcc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b71cb67854e429fa6088fd4ccf5d206, user_id=11da6d64e6d0449db4378ff5e3341743, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:42.631128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c86ca-c788-4ab8-8ea0-0e004865dcc1 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:42.643002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1232/2490] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 12:58:42 2022] PUT /identity/v3/projects/4b71cb67854e429fa6088fd4ccf5d206/users/11da6d64e6d0449db4378ff5e3341743/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:58:42.653482 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc639-e8f6-48c1-88cc-d68f566a8cb6 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.653791 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc639-e8f6-48c1-88cc-d68f566a8cb6 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.654065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc639-e8f6-48c1-88cc-d68f566a8cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.682364 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2c3dc639-e8f6-48c1-88cc-d68f566a8cb6 None None] MFA Rules not processed for user `11da6d64e6d0449db4378ff5e3341743`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:58:42.683576 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2c3dc639-e8f6-48c1-88cc-d68f566a8cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:58:42.747574 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1259/2491] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:58:42.759558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c86ca-c788-4ab8-8ea0-0e004865dcc1 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:58:42.761268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6c5c86ca-c788-4ab8-8ea0-0e004865dcc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:58:42.836869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c86ca-c788-4ab8-8ea0-0e004865dcc1 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:58:42.840834 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24625223-0fb2-4b56-b31f-6695ac7736ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:58:42.841418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24625223-0fb2-4b56-b31f-6695ac7736ec service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:58:42.841736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24625223-0fb2-4b56-b31f-6695ac7736ec service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:58:42.842020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24625223-0fb2-4b56-b31f-6695ac7736ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:58:42.850747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24625223-0fb2-4b56-b31f-6695ac7736ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:58:42.852201 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24625223-0fb2-4b56-b31f-6695ac7736ec service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:58:42.860746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1233/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:58:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:59:03.722782 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed95254-efb4-4cc3-bb55-09cc5d3a5c61 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:59:03.723387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed95254-efb4-4cc3-bb55-09cc5d3a5c61 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:59:03.723387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed95254-efb4-4cc3-bb55-09cc5d3a5c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:59:03.741708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-6ed95254-efb4-4cc3-bb55-09cc5d3a5c61 None None] MFA Rules not processed for user `c9e498e3dae54ffab54d93958bfc2ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:59:03.742892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6ed95254-efb4-4cc3-bb55-09cc5d3a5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:03.796625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1260/2493] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:59:18.868877 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24625223-0fb2-4b56-b31f-6695ac7736ec service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:59:18.930778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24625223-0fb2-4b56-b31f-6695ac7736ec service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:59:18.935411 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:59:18.936286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:59:18.936564 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:59:18.936835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] PATH_INFO: `/v3/users/11da6d64e6d0449db4378ff5e3341743` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:59:18.938390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11da6d64e6d0449db4378ff5e3341743)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:59:18.940753 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:59:18.985359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11da6d64e6d0449db4378ff5e3341743'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:59:18.985966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11da6d64e6d0449db4378ff5e3341743'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:59:18.987167 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11da6d64e6d0449db4378ff5e3341743'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:59:18.993717 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11da6d64e6d0449db4378ff5e3341743'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:59:19.004926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11da6d64e6d0449db4378ff5e3341743'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:59:19.018027 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1234/2494] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 12:59:18 2022] DELETE /identity/v3/users/11da6d64e6d0449db4378ff5e3341743 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:59:19.022590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d8221-4db2-40ca-bfab-8a2e52e0c571 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:59:19.023054 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d8221-4db2-40ca-bfab-8a2e52e0c571 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:59:19.023171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d8221-4db2-40ca-bfab-8a2e52e0c571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:59:19.041686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-229d8221-4db2-40ca-bfab-8a2e52e0c571 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:59:19.042869 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-229d8221-4db2-40ca-bfab-8a2e52e0c571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:19.099825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1261/2495] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:59:19.109496 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:59:19.110939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:19.170630 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169311b-5eaf-42b8-ad49-9c238273da87 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:59:19.175918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9981ca-d825-49ba-bd23-c1ea6100b69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:59:19.176573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9981ca-d825-49ba-bd23-c1ea6100b69d service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:59:19.176874 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9981ca-d825-49ba-bd23-c1ea6100b69d service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:59:19.177142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9981ca-d825-49ba-bd23-c1ea6100b69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:59:19.186466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9981ca-d825-49ba-bd23-c1ea6100b69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:59:19.187964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9981ca-d825-49ba-bd23-c1ea6100b69d service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:59:19.198364 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1235/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 12:59:19.533923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d8221-4db2-40ca-bfab-8a2e52e0c571 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:59:19.537460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-229d8221-4db2-40ca-bfab-8a2e52e0c571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:19.572005 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d8221-4db2-40ca-bfab-8a2e52e0c571 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:59:19.580976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:59:19.583237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:59:19.583237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:59:19.583237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] PATH_INFO: `/v3/projects/4b71cb67854e429fa6088fd4ccf5d206` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:59:19.585489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b71cb67854e429fa6088fd4ccf5d206)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:59:19.587740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:59:19.662342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b71cb67854e429fa6088fd4ccf5d206', 'request_id': 'req-615cb0b5-0532-4732-a0bb-7580adb4ecba'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:59:19.673165 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b71cb67854e429fa6088fd4ccf5d206', 'request_id': 'req-615cb0b5-0532-4732-a0bb-7580adb4ecba'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:59:19.682444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b71cb67854e429fa6088fd4ccf5d206', 'request_id': 'req-615cb0b5-0532-4732-a0bb-7580adb4ecba'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:59:19.694580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] The token cache is being invalidate because project 4b71cb67854e429fa6088fd4ccf5d206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 12:59:19.694996 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:59:19.696344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-615cb0b5-0532-4732-a0bb-7580adb4ecba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 12:59:19.700944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1262/2497] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 12:59:19 2022] DELETE /identity/v3/projects/4b71cb67854e429fa6088fd4ccf5d206 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 12:59:26.479616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abebe2-1b9d-4fb0-88b0-99dac2fab231 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:59:26.480116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abebe2-1b9d-4fb0-88b0-99dac2fab231 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:59:26.480215 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abebe2-1b9d-4fb0-88b0-99dac2fab231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:59:26.498447 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-41abebe2-1b9d-4fb0-88b0-99dac2fab231 None None] MFA Rules not processed for user `c07f9210231742ffac3dae4b75887d66`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:59:26.499654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-41abebe2-1b9d-4fb0-88b0-99dac2fab231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:26.553962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1236/2498] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:59:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:59:32.092773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab789f-72c9-468c-b55a-70ebfbedac5e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:59:32.093381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab789f-72c9-468c-b55a-70ebfbedac5e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:59:32.093381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab789f-72c9-468c-b55a-70ebfbedac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:59:32.113049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-0aab789f-72c9-468c-b55a-70ebfbedac5e None None] MFA Rules not processed for user `00d5aeec35784bfb80b431605ef02a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:59:32.114206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0aab789f-72c9-468c-b55a-70ebfbedac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:32.170608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1263/2499] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 12:59:57.724002 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484dead-0123-4df8-823e-bfcb944ad2b3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:59:57.724636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484dead-0123-4df8-823e-bfcb944ad2b3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:59:57.724636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484dead-0123-4df8-823e-bfcb944ad2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:59:57.744404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-1484dead-0123-4df8-823e-bfcb944ad2b3 None None] MFA Rules not processed for user `ef623fa30c4647e18d9dd3f81704e0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 12:59:57.745537 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1484dead-0123-4df8-823e-bfcb944ad2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:57.808835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1237/2500] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 12:59:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 12:59:57.858106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab789f-72c9-468c-b55a-70ebfbedac5e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:59:57.860401 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0aab789f-72c9-468c-b55a-70ebfbedac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:57.942186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab789f-72c9-468c-b55a-70ebfbedac5e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:59:57.946149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6abf-aec0-47cc-9a75-7967a1945cbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:59:57.946835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6abf-aec0-47cc-9a75-7967a1945cbd service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:59:57.947116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6abf-aec0-47cc-9a75-7967a1945cbd service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:59:57.947419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6abf-aec0-47cc-9a75-7967a1945cbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:59:57.949310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-beda6abf-aec0-47cc-9a75-7967a1945cbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:58.041232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda6abf-aec0-47cc-9a75-7967a1945cbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:59:58.043418 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda6abf-aec0-47cc-9a75-7967a1945cbd service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:59:58.055983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1264/2501] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:59:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 12:59:58.971260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484dead-0123-4df8-823e-bfcb944ad2b3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 12:59:58.973423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1484dead-0123-4df8-823e-bfcb944ad2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:59.039187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484dead-0123-4df8-823e-bfcb944ad2b3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 12:59:59.044669 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d49f6-e3ee-4918-9d33-c5fd2a13d7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 12:59:59.045467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d49f6-e3ee-4918-9d33-c5fd2a13d7bb service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 12:59:59.045774 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d49f6-e3ee-4918-9d33-c5fd2a13d7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 12:59:59.045991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d49f6-e3ee-4918-9d33-c5fd2a13d7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 12:59:59.048641 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0e7d49f6-e3ee-4918-9d33-c5fd2a13d7bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 12:59:59.063528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d49f6-e3ee-4918-9d33-c5fd2a13d7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 12:59:59.065257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d49f6-e3ee-4918-9d33-c5fd2a13d7bb service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 12:59:59.079529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1238/2502] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 12:59:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:10.119274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6abf-aec0-47cc-9a75-7967a1945cbd service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:10.120735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-beda6abf-aec0-47cc-9a75-7967a1945cbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:10.133224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6abf-aec0-47cc-9a75-7967a1945cbd service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:10.137025 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39bd72-28ba-4099-87cf-6a8245a2ae19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:10.137757 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39bd72-28ba-4099-87cf-6a8245a2ae19 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:10.138042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39bd72-28ba-4099-87cf-6a8245a2ae19 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:10.138314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39bd72-28ba-4099-87cf-6a8245a2ae19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:10.140170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-af39bd72-28ba-4099-87cf-6a8245a2ae19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:10.204850 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39bd72-28ba-4099-87cf-6a8245a2ae19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:10.206334 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39bd72-28ba-4099-87cf-6a8245a2ae19 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:10.216190 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1265/2503] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:13.774546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d49f6-e3ee-4918-9d33-c5fd2a13d7bb service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:13.776086 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0e7d49f6-e3ee-4918-9d33-c5fd2a13d7bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:13.790714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d49f6-e3ee-4918-9d33-c5fd2a13d7bb service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:13.795332 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:13.796795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:13.797109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:13.797392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] PATH_INFO: `/v3/users/c9e498e3dae54ffab54d93958bfc2ef4` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:13.798632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e498e3dae54ffab54d93958bfc2ef4)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:13.800638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:13.852054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e498e3dae54ffab54d93958bfc2ef4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:00:13.852647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e498e3dae54ffab54d93958bfc2ef4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:00:13.853262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e498e3dae54ffab54d93958bfc2ef4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:00:13.860755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e498e3dae54ffab54d93958bfc2ef4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:00:13.871972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7c49f19f-c917-4f20-a755-7f6307c2069d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e498e3dae54ffab54d93958bfc2ef4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:00:13.885640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1239/2504] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:00:13 2022] DELETE /identity/v3/users/c9e498e3dae54ffab54d93958bfc2ef4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:00:14.055338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39bd72-28ba-4099-87cf-6a8245a2ae19 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:14.066299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39bd72-28ba-4099-87cf-6a8245a2ae19 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:14.125966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:14.126731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.127006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.127276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] PATH_INFO: `/v3/projects/ced8aa6655764afdafefdfa6e3726d63` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.128439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced8aa6655764afdafefdfa6e3726d63)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:14.130395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:14.175910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced8aa6655764afdafefdfa6e3726d63', 'request_id': 'req-63736e4a-153c-4d01-a16d-c4be20462873'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:00:14.182061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced8aa6655764afdafefdfa6e3726d63', 'request_id': 'req-63736e4a-153c-4d01-a16d-c4be20462873'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:00:14.190303 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced8aa6655764afdafefdfa6e3726d63', 'request_id': 'req-63736e4a-153c-4d01-a16d-c4be20462873'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:00:14.200261 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] The token cache is being invalidate because project ced8aa6655764afdafefdfa6e3726d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:00:14.200550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:00:14.201170 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-63736e4a-153c-4d01-a16d-c4be20462873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:00:14.203421 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1266/2505] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:00:14 2022] DELETE /identity/v3/projects/ced8aa6655764afdafefdfa6e3726d63 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:00:14.209425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5281e-bc69-44db-b8ba-ea3878e611eb None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.209747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5281e-bc69-44db-b8ba-ea3878e611eb None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.210033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5281e-bc69-44db-b8ba-ea3878e611eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.230062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-45d5281e-bc69-44db-b8ba-ea3878e611eb None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:00:14.231260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-45d5281e-bc69-44db-b8ba-ea3878e611eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:14.290969 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1240/2506] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:00:14.299599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df902-17af-4e64-b8c4-cc6c387731d2 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.299924 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df902-17af-4e64-b8c4-cc6c387731d2 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.300230 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df902-17af-4e64-b8c4-cc6c387731d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.318870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b60df902-17af-4e64-b8c4-cc6c387731d2 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:00:14.320067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b60df902-17af-4e64-b8c4-cc6c387731d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:14.332965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1267/2507] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:00:14.337245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5281e-bc69-44db-b8ba-ea3878e611eb None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:14.347693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5281e-bc69-44db-b8ba-ea3878e611eb None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:14.352362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472931e8-3cd4-4bf2-bf57-ef1a78a071f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:14.353033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472931e8-3cd4-4bf2-bf57-ef1a78a071f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.353316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472931e8-3cd4-4bf2-bf57-ef1a78a071f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.353614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472931e8-3cd4-4bf2-bf57-ef1a78a071f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.354350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472931e8-3cd4-4bf2-bf57-ef1a78a071f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:00:14.354661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472931e8-3cd4-4bf2-bf57-ef1a78a071f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:14.356288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472931e8-3cd4-4bf2-bf57-ef1a78a071f4 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:14.368094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1241/2508] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:00:14.372457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df902-17af-4e64-b8c4-cc6c387731d2 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:14.382726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df902-17af-4e64-b8c4-cc6c387731d2 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:14.387445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c0be2-4ed3-48fa-bafd-b84221a8cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:14.388106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c0be2-4ed3-48fa-bafd-b84221a8cf94 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.388392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c0be2-4ed3-48fa-bafd-b84221a8cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.388666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c0be2-4ed3-48fa-bafd-b84221a8cf94 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.389375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c0be2-4ed3-48fa-bafd-b84221a8cf94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:14.392720 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c0be2-4ed3-48fa-bafd-b84221a8cf94 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:14.419948 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1268/2509] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:00:14 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:00:14.425044 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472931e8-3cd4-4bf2-bf57-ef1a78a071f4 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:14.435343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472931e8-3cd4-4bf2-bf57-ef1a78a071f4 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:14.495154 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316b45-7355-4cc4-8d8b-4fd4b54e2f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:14.496021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316b45-7355-4cc4-8d8b-4fd4b54e2f7c admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.496327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316b45-7355-4cc4-8d8b-4fd4b54e2f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.496608 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9316b45-7355-4cc4-8d8b-4fd4b54e2f7c admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.497291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9316b45-7355-4cc4-8d8b-4fd4b54e2f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:14.499308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9316b45-7355-4cc4-8d8b-4fd4b54e2f7c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:14.520620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1242/2510] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:00:14 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:00:14.525376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c0be2-4ed3-48fa-bafd-b84221a8cf94 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:14.536943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c0be2-4ed3-48fa-bafd-b84221a8cf94 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:14.542075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844f041-3e10-4502-bfc5-705c04cfbf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:14.542829 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f041-3e10-4502-bfc5-705c04cfbf88 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.543120 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f041-3e10-4502-bfc5-705c04cfbf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.543404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844f041-3e10-4502-bfc5-705c04cfbf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.544140 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844f041-3e10-4502-bfc5-705c04cfbf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:14.545787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844f041-3e10-4502-bfc5-705c04cfbf88 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:14.557114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1269/2511] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:00:14.561317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316b45-7355-4cc4-8d8b-4fd4b54e2f7c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:14.571381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9316b45-7355-4cc4-8d8b-4fd4b54e2f7c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:14.576178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cb3dc-026a-4ebb-8b3a-a5ce3d55ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:14.576835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cb3dc-026a-4ebb-8b3a-a5ce3d55ce48 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.577118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cb3dc-026a-4ebb-8b3a-a5ce3d55ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.577423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cb3dc-026a-4ebb-8b3a-a5ce3d55ce48 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.578182 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cb3dc-026a-4ebb-8b3a-a5ce3d55ce48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:14.579794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cb3dc-026a-4ebb-8b3a-a5ce3d55ce48 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:14.590141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1243/2512] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 13:00:14.595273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844f041-3e10-4502-bfc5-705c04cfbf88 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:14.605258 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844f041-3e10-4502-bfc5-705c04cfbf88 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:14.610921 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91d5fd-7972-44f7-9abe-7099709ad186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:14.611805 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d5fd-7972-44f7-9abe-7099709ad186 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.612087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d5fd-7972-44f7-9abe-7099709ad186 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.612383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d5fd-7972-44f7-9abe-7099709ad186 admin admin] PATH_INFO: `/v3/projects/f566084a0b414e6dabf96eae8ae4d7ac/users/db5913ed289942bc9a57c25b9c0e2e46/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.628291 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91d5fd-7972-44f7-9abe-7099709ad186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f566084a0b414e6dabf96eae8ae4d7ac, user_id=db5913ed289942bc9a57c25b9c0e2e46, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:14.630999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91d5fd-7972-44f7-9abe-7099709ad186 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:14.646366 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1270/2513] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:00:14 2022] PUT /identity/v3/projects/f566084a0b414e6dabf96eae8ae4d7ac/users/db5913ed289942bc9a57c25b9c0e2e46/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:00:14.651368 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b869b5-d437-44dd-a7d0-0ba5450d2ef4 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.651653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b869b5-d437-44dd-a7d0-0ba5450d2ef4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.651926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b869b5-d437-44dd-a7d0-0ba5450d2ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.669478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-a3b869b5-d437-44dd-a7d0-0ba5450d2ef4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:00:14.670694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a3b869b5-d437-44dd-a7d0-0ba5450d2ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:14.728401 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1244/2514] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:00:14.738721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91d5fd-7972-44f7-9abe-7099709ad186 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:14.740448 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2e91d5fd-7972-44f7-9abe-7099709ad186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:14.803985 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91d5fd-7972-44f7-9abe-7099709ad186 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:14.808215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752f076-178b-4bb8-993d-cd7d14409b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:14.808875 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f076-178b-4bb8-993d-cd7d14409b06 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:14.809162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f076-178b-4bb8-993d-cd7d14409b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:14.809441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f076-178b-4bb8-993d-cd7d14409b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:14.821062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752f076-178b-4bb8-993d-cd7d14409b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:14.822525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752f076-178b-4bb8-993d-cd7d14409b06 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:14.832907 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1271/2515] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:17.253436 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b869b5-d437-44dd-a7d0-0ba5450d2ef4 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:17.255021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a3b869b5-d437-44dd-a7d0-0ba5450d2ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:17.386214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b869b5-d437-44dd-a7d0-0ba5450d2ef4 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:17.395276 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2c355-a8ee-4941-b2db-66b58d332078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:17.396142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2c355-a8ee-4941-b2db-66b58d332078 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:17.396621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2c355-a8ee-4941-b2db-66b58d332078 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:17.397116 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2c355-a8ee-4941-b2db-66b58d332078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:17.399879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1cf2c355-a8ee-4941-b2db-66b58d332078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:17.465897 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2c355-a8ee-4941-b2db-66b58d332078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:17.468168 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2c355-a8ee-4941-b2db-66b58d332078 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:17.479424 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1245/2516] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:19.239714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752f076-178b-4bb8-993d-cd7d14409b06 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:19.242329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1752f076-178b-4bb8-993d-cd7d14409b06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:19.269332 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752f076-178b-4bb8-993d-cd7d14409b06 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:19.292690 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf8a31-bb64-4375-b2f4-f21b76aece3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:19.302634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf8a31-bb64-4375-b2f4-f21b76aece3a service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:19.303406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf8a31-bb64-4375-b2f4-f21b76aece3a service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:19.305958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf8a31-bb64-4375-b2f4-f21b76aece3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:19.313909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0acf8a31-bb64-4375-b2f4-f21b76aece3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:19.351820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf8a31-bb64-4375-b2f4-f21b76aece3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:19.355138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf8a31-bb64-4375-b2f4-f21b76aece3a service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:19.398665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1272/2517] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:19.674307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98700-d106-4b01-8234-5872cfecffc7 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:19.674887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98700-d106-4b01-8234-5872cfecffc7 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:19.675308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98700-d106-4b01-8234-5872cfecffc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:19.729534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-30a98700-d106-4b01-8234-5872cfecffc7 None None] MFA Rules not processed for user `db5913ed289942bc9a57c25b9c0e2e46`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:00:19.732334 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-30a98700-d106-4b01-8234-5872cfecffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:19.841077 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1246/2518] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:00:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:00:19.857381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf8a31-bb64-4375-b2f4-f21b76aece3a service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:19.877662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf8a31-bb64-4375-b2f4-f21b76aece3a service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:19.886191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d035a-5c2e-4aaf-9758-274e515cc0a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:19.887271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d035a-5c2e-4aaf-9758-274e515cc0a5 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:19.887616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d035a-5c2e-4aaf-9758-274e515cc0a5 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:19.887894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d035a-5c2e-4aaf-9758-274e515cc0a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:19.897937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d035a-5c2e-4aaf-9758-274e515cc0a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:19.899565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d035a-5c2e-4aaf-9758-274e515cc0a5 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:19.910204 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1273/2519] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:21.851745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97850ed-8f23-4b02-8740-3621680e9a80 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:21.852206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97850ed-8f23-4b02-8740-3621680e9a80 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:21.852363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97850ed-8f23-4b02-8740-3621680e9a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:21.875755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f97850ed-8f23-4b02-8740-3621680e9a80 None None] MFA Rules not processed for user `db5913ed289942bc9a57c25b9c0e2e46`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:00:21.877688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f97850ed-8f23-4b02-8740-3621680e9a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:21.893275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1247/2520] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:00:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:00:23.267038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d035a-5c2e-4aaf-9758-274e515cc0a5 service nova] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:23.272896 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2e2d035a-5c2e-4aaf-9758-274e515cc0a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:23.572853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d035a-5c2e-4aaf-9758-274e515cc0a5 service nova] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:23.585839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c281e-4390-443a-87ef-4580f1cb73f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221dab3ebc4f4c68b253729391e9c503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:23.586855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c281e-4390-443a-87ef-4580f1cb73f7 service placement] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:23.587484 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c281e-4390-443a-87ef-4580f1cb73f7 service placement] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:23.588714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c281e-4390-443a-87ef-4580f1cb73f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:23.598914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-154c281e-4390-443a-87ef-4580f1cb73f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:23.620394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c281e-4390-443a-87ef-4580f1cb73f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:23.623085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c281e-4390-443a-87ef-4580f1cb73f7 service placement] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:23.642899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1274/2521] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:26.572886 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97850ed-8f23-4b02-8740-3621680e9a80 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:26.575242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f97850ed-8f23-4b02-8740-3621680e9a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:26.610359 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97850ed-8f23-4b02-8740-3621680e9a80 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:26.619289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761de1a-e98f-444c-9ea9-d0b7b287f0cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:26.620270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761de1a-e98f-444c-9ea9-d0b7b287f0cd service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:26.620959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761de1a-e98f-444c-9ea9-d0b7b287f0cd service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:26.621416 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761de1a-e98f-444c-9ea9-d0b7b287f0cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:26.624746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0761de1a-e98f-444c-9ea9-d0b7b287f0cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:26.647546 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761de1a-e98f-444c-9ea9-d0b7b287f0cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:26.651056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761de1a-e98f-444c-9ea9-d0b7b287f0cd service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:26.672306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1248/2522] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:31.544172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0572-3517-4655-93f3-6d380561d57e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:31.544974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0572-3517-4655-93f3-6d380561d57e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:31.544974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d0572-3517-4655-93f3-6d380561d57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:31.568078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-cb4d0572-3517-4655-93f3-6d380561d57e None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:00:31.569432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cb4d0572-3517-4655-93f3-6d380561d57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:31.645468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1275/2523] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 13:00:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:00:31.703748 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761de1a-e98f-444c-9ea9-d0b7b287f0cd service nova] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:31.705664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0761de1a-e98f-444c-9ea9-d0b7b287f0cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:31.794843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761de1a-e98f-444c-9ea9-d0b7b287f0cd service nova] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:31.805202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003408d4-00d6-4483-bd3b-efcaf8c92cfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:31.806842 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003408d4-00d6-4483-bd3b-efcaf8c92cfa service swift] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:31.807472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003408d4-00d6-4483-bd3b-efcaf8c92cfa service swift] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:31.807931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003408d4-00d6-4483-bd3b-efcaf8c92cfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:31.820772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003408d4-00d6-4483-bd3b-efcaf8c92cfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:31.823257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003408d4-00d6-4483-bd3b-efcaf8c92cfa service swift] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:31.836322 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1249/2524] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 13:00:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 06 13:00:41.113279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f836f-55a9-4cf0-8b56-bb37af53fabd None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:41.114727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f836f-55a9-4cf0-8b56-bb37af53fabd None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:41.115802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f836f-55a9-4cf0-8b56-bb37af53fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:41.159552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-702f836f-55a9-4cf0-8b56-bb37af53fabd None None] MFA Rules not processed for user `00d5aeec35784bfb80b431605ef02a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:00:41.161082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-702f836f-55a9-4cf0-8b56-bb37af53fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:41.288824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1276/2525] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:00:41.690451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003408d4-00d6-4483-bd3b-efcaf8c92cfa service swift] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:41.700283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003408d4-00d6-4483-bd3b-efcaf8c92cfa service swift] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:41.704394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22370f9b-58b2-4466-ab5b-2fb0edd09aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:41.705071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22370f9b-58b2-4466-ab5b-2fb0edd09aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:41.705350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22370f9b-58b2-4466-ab5b-2fb0edd09aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:41.705657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22370f9b-58b2-4466-ab5b-2fb0edd09aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:41.707654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-22370f9b-58b2-4466-ab5b-2fb0edd09aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:41.719211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22370f9b-58b2-4466-ab5b-2fb0edd09aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:41.720842 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22370f9b-58b2-4466-ab5b-2fb0edd09aa6 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:41.730148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1250/2526] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:46.811377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f836f-55a9-4cf0-8b56-bb37af53fabd None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:46.827368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f836f-55a9-4cf0-8b56-bb37af53fabd None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:46.834359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67ca03-584a-407c-aacd-4f04a2fc0e7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:46.835480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67ca03-584a-407c-aacd-4f04a2fc0e7b service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:46.835996 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67ca03-584a-407c-aacd-4f04a2fc0e7b service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:46.836425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67ca03-584a-407c-aacd-4f04a2fc0e7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:46.838723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4d67ca03-584a-407c-aacd-4f04a2fc0e7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:46.853715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67ca03-584a-407c-aacd-4f04a2fc0e7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:46.855664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67ca03-584a-407c-aacd-4f04a2fc0e7b service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:46.871891 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1277/2527] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:00:48.183725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2fd33-c14d-4e0e-a017-071493288cc9 None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:48.184305 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2fd33-c14d-4e0e-a017-071493288cc9 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:48.184420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2fd33-c14d-4e0e-a017-071493288cc9 None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:48.185935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1251/2528] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 13:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 13:00:48.192456 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492acc7-99c1-4e0d-a564-aa7184134c5c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:48.192957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492acc7-99c1-4e0d-a564-aa7184134c5c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:48.193194 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492acc7-99c1-4e0d-a564-aa7184134c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:48.218121 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-c492acc7-99c1-4e0d-a564-aa7184134c5c None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:00:48.219342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c492acc7-99c1-4e0d-a564-aa7184134c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:48.229132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1278/2529] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:00:48.242826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2fd33-c14d-4e0e-a017-071493288cc9 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:48.244541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-08a2fd33-c14d-4e0e-a017-071493288cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:48.315830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2fd33-c14d-4e0e-a017-071493288cc9 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:48.319811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861cddb9-9762-4d0b-b88d-3ad93e6f51dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7330a81c0f3a496ea29ae911fcc69221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:48.320557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cddb9-9762-4d0b-b88d-3ad93e6f51dd service glance] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:48.320842 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cddb9-9762-4d0b-b88d-3ad93e6f51dd service glance] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:48.321720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cddb9-9762-4d0b-b88d-3ad93e6f51dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:48.338554 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cddb9-9762-4d0b-b88d-3ad93e6f51dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:48.340022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861cddb9-9762-4d0b-b88d-3ad93e6f51dd service glance] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:48.354326 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1252/2530] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:48.427804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d046b-a679-4d6e-9007-00726966e90a None None] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:48.428000 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d046b-a679-4d6e-9007-00726966e90a None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:48.428263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d046b-a679-4d6e-9007-00726966e90a None None] PATH_INFO: `/` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:48.429665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1279/2531] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 13:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 06 13:00:48.438563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941da3-452d-4844-a922-43ea974bb8a5 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:48.438853 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941da3-452d-4844-a922-43ea974bb8a5 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:48.439130 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c941da3-452d-4844-a922-43ea974bb8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:48.459582 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3c941da3-452d-4844-a922-43ea974bb8a5 None None] MFA Rules not processed for user `7bd327cdfe2c4f729252d86838aae638`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:00:48.460801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3c941da3-452d-4844-a922-43ea974bb8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:48.468561 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1253/2532] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:00:48.480741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d046b-a679-4d6e-9007-00726966e90a None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:48.500792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d046b-a679-4d6e-9007-00726966e90a None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:48.505425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd167d1-1215-4094-a3e5-9f348d93850f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:48.506108 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd167d1-1215-4094-a3e5-9f348d93850f service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:48.506393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd167d1-1215-4094-a3e5-9f348d93850f service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:48.506666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd167d1-1215-4094-a3e5-9f348d93850f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:48.515053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd167d1-1215-4094-a3e5-9f348d93850f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:48.516506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd167d1-1215-4094-a3e5-9f348d93850f service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:48.524643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1280/2533] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:00:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:00:50.424003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977501-102f-4ab9-9c50-9cd6d84ba9b3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:50.424466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977501-102f-4ab9-9c50-9cd6d84ba9b3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:50.424573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49977501-102f-4ab9-9c50-9cd6d84ba9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:50.447128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-49977501-102f-4ab9-9c50-9cd6d84ba9b3 None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:00:50.448180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-49977501-102f-4ab9-9c50-9cd6d84ba9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:00:50.455567 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1254/2534] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:00:50.470407 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd167d1-1215-4094-a3e5-9f348d93850f service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:00:50.483730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd167d1-1215-4094-a3e5-9f348d93850f service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:00:50.489056 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6597-2561-4c02-b4ee-d65c2590f453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:00:50.489740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6597-2561-4c02-b4ee-d65c2590f453 service swift] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:00:50.490042 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6597-2561-4c02-b4ee-d65c2590f453 service swift] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:00:50.490300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6597-2561-4c02-b4ee-d65c2590f453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:00:50.499677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6597-2561-4c02-b4ee-d65c2590f453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:00:50.501285 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6597-2561-4c02-b4ee-d65c2590f453 service swift] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:00:50.509894 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1281/2535] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 13:00:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 13:01:04.874004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49977501-102f-4ab9-9c50-9cd6d84ba9b3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:04.884075 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49977501-102f-4ab9-9c50-9cd6d84ba9b3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:04.889178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cd556-86be-4087-a8ac-0cf1441e2ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:04.889875 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cd556-86be-4087-a8ac-0cf1441e2ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:04.890149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cd556-86be-4087-a8ac-0cf1441e2ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:04.890732 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cd556-86be-4087-a8ac-0cf1441e2ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:04.892714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e44cd556-86be-4087-a8ac-0cf1441e2ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:04.904685 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cd556-86be-4087-a8ac-0cf1441e2ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:04.906261 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cd556-86be-4087-a8ac-0cf1441e2ce7 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:04.915955 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1255/2536] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:01:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:01:05.136569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6597-2561-4c02-b4ee-d65c2590f453 service swift] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:05.154379 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7aebd-aa19-47dd-9832-8bed7714104f None None] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:05.154891 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7aebd-aa19-47dd-9832-8bed7714104f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:05.155524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7aebd-aa19-47dd-9832-8bed7714104f None None] PATH_INFO: `/` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:05.156895 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1256/2537] 10.222.0.23 () {54 vars in 921 bytes} [Wed Apr 6 13:01:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 06 13:01:05.160632 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6597-2561-4c02-b4ee-d65c2590f453 service swift] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:05.168160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b10cb9-7ad1-45ac-8e34-f408045607bd None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:05.168452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b10cb9-7ad1-45ac-8e34-f408045607bd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:05.169295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b10cb9-7ad1-45ac-8e34-f408045607bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:05.173712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300b8e-d702-483a-9a16-1b7e71498b8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:05.174353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300b8e-d702-483a-9a16-1b7e71498b8a service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:05.174597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300b8e-d702-483a-9a16-1b7e71498b8a service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:05.174872 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67300b8e-d702-483a-9a16-1b7e71498b8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:05.176915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-67300b8e-d702-483a-9a16-1b7e71498b8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:05.196935 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-07b10cb9-7ad1-45ac-8e34-f408045607bd None None] MFA Rules not processed for user `65b295446c7741ea96caf60ac955d82d`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:01:05.199350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-07b10cb9-7ad1-45ac-8e34-f408045607bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:05.201282 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67300b8e-d702-483a-9a16-1b7e71498b8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:05.203788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67300b8e-d702-483a-9a16-1b7e71498b8a service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:05.212065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1257/2538] 10.222.0.23 () {58 vars in 1018 bytes} [Wed Apr 6 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:01:05.214367 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bcb2a-60ba-48e1-af3a-df9534613566 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:05.214878 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bcb2a-60ba-48e1-af3a-df9534613566 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:05.215342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bcb2a-60ba-48e1-af3a-df9534613566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:05.224570 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1282/2539] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:01:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:01:05.225612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300b8e-d702-483a-9a16-1b7e71498b8a service nova] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:05.240863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67300b8e-d702-483a-9a16-1b7e71498b8a service nova] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:05.246388 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5879398-c1a1-4c84-89a4-5a6567808e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:05.247900 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5879398-c1a1-4c84-89a4-5a6567808e61 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:05.248493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5879398-c1a1-4c84-89a4-5a6567808e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:05.248983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5879398-c1a1-4c84-89a4-5a6567808e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:05.269188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5879398-c1a1-4c84-89a4-5a6567808e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:05.269313 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-5f0bcb2a-60ba-48e1-af3a-df9534613566 None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:01:05.269420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5879398-c1a1-4c84-89a4-5a6567808e61 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:05.269522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-5f0bcb2a-60ba-48e1-af3a-df9534613566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:05.284648 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1258/2540] 10.222.0.23 () {58 vars in 967 bytes} [Wed Apr 6 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:01:05.290017 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1283/2541] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:01:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:01:05.306235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bcb2a-60ba-48e1-af3a-df9534613566 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:05.334387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bcb2a-60ba-48e1-af3a-df9534613566 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:05.340607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12a719-36da-4478-ba88-87508dbed557 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:05.343725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a719-36da-4478-ba88-87508dbed557 service swift] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:05.344255 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a719-36da-4478-ba88-87508dbed557 service swift] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:05.344757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a719-36da-4478-ba88-87508dbed557 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:05.379255 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12a719-36da-4478-ba88-87508dbed557 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:05.381253 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12a719-36da-4478-ba88-87508dbed557 service swift] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:05.403496 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1259/2542] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 13:01:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 13:01:43.133006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5879398-c1a1-4c84-89a4-5a6567808e61 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:43.144779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5879398-c1a1-4c84-89a4-5a6567808e61 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:43.150352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9931fa6-ec7a-4395-a2da-4f585c69d5d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:43.151132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9931fa6-ec7a-4395-a2da-4f585c69d5d9 service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:43.151981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9931fa6-ec7a-4395-a2da-4f585c69d5d9 service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:43.152759 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9931fa6-ec7a-4395-a2da-4f585c69d5d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:43.154828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c9931fa6-ec7a-4395-a2da-4f585c69d5d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:43.165807 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9931fa6-ec7a-4395-a2da-4f585c69d5d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:43.168129 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9931fa6-ec7a-4395-a2da-4f585c69d5d9 service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:43.177591 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1284/2543] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:01:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:01:53.468313 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12a719-36da-4478-ba88-87508dbed557 service swift] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:53.478306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12a719-36da-4478-ba88-87508dbed557 service swift] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:53.482708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59f4a5-5099-4abd-ba5d-07d51ac90960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:53.483361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59f4a5-5099-4abd-ba5d-07d51ac90960 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:53.483649 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59f4a5-5099-4abd-ba5d-07d51ac90960 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:53.483925 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59f4a5-5099-4abd-ba5d-07d51ac90960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:53.486215 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-dd59f4a5-5099-4abd-ba5d-07d51ac90960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:53.499107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59f4a5-5099-4abd-ba5d-07d51ac90960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:53.500577 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59f4a5-5099-4abd-ba5d-07d51ac90960 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:53.510764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1260/2544] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:01:57.865313 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9931fa6-ec7a-4395-a2da-4f585c69d5d9 service nova] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:57.866844 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c9931fa6-ec7a-4395-a2da-4f585c69d5d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:57.880713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9931fa6-ec7a-4395-a2da-4f585c69d5d9 service nova] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:57.885830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:57.886876 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:57.887159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:57.887432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] PATH_INFO: `/v3/users/c07f9210231742ffac3dae4b75887d66` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:57.888661 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07f9210231742ffac3dae4b75887d66)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:57.890619 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:57.939192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07f9210231742ffac3dae4b75887d66'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:01:57.939899 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07f9210231742ffac3dae4b75887d66'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:01:57.940590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07f9210231742ffac3dae4b75887d66'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:01:57.955406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07f9210231742ffac3dae4b75887d66'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:01:57.963824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-20109492-26a0-4a92-98ef-9bb7ab1396c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07f9210231742ffac3dae4b75887d66'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:01:57.977854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1285/2545] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:01:57 2022] DELETE /identity/v3/users/c07f9210231742ffac3dae4b75887d66 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:01:58.154025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59f4a5-5099-4abd-ba5d-07d51ac90960 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:58.165339 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59f4a5-5099-4abd-ba5d-07d51ac90960 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:58.221162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:58.222095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.222384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.222664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] PATH_INFO: `/v3/projects/03051cb3880e4976b0d195248d3000a6` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.223857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03051cb3880e4976b0d195248d3000a6)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:58.225835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:58.271905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03051cb3880e4976b0d195248d3000a6', 'request_id': 'req-b7a3439d-f32d-4535-a9e2-ed7fac975757'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:01:58.277707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03051cb3880e4976b0d195248d3000a6', 'request_id': 'req-b7a3439d-f32d-4535-a9e2-ed7fac975757'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:01:58.284163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03051cb3880e4976b0d195248d3000a6', 'request_id': 'req-b7a3439d-f32d-4535-a9e2-ed7fac975757'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:01:58.295699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] The token cache is being invalidate because project 03051cb3880e4976b0d195248d3000a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:01:58.295979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:01:58.296595 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b7a3439d-f32d-4535-a9e2-ed7fac975757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:01:58.298158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1261/2546] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:01:58 2022] DELETE /identity/v3/projects/03051cb3880e4976b0d195248d3000a6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:01:58.303142 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15039c98-589f-479a-8667-5ca75453c5f4 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.303458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15039c98-589f-479a-8667-5ca75453c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.303738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15039c98-589f-479a-8667-5ca75453c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.320997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-15039c98-589f-479a-8667-5ca75453c5f4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:01:58.322246 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-15039c98-589f-479a-8667-5ca75453c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:58.383368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1286/2547] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:01:58.391972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5809df-3c5a-4474-b437-9bede381ada6 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.392289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5809df-3c5a-4474-b437-9bede381ada6 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.392572 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5809df-3c5a-4474-b437-9bede381ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.411599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-eb5809df-3c5a-4474-b437-9bede381ada6 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:01:58.412806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-eb5809df-3c5a-4474-b437-9bede381ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:58.421164 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1262/2548] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:01:58.425520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15039c98-589f-479a-8667-5ca75453c5f4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:58.435312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15039c98-589f-479a-8667-5ca75453c5f4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:58.439912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66c0ec-55df-4ad9-8332-3b91111e0665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:58.440568 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66c0ec-55df-4ad9-8332-3b91111e0665 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.440847 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66c0ec-55df-4ad9-8332-3b91111e0665 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.441119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66c0ec-55df-4ad9-8332-3b91111e0665 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.441883 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66c0ec-55df-4ad9-8332-3b91111e0665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:01:58.442188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66c0ec-55df-4ad9-8332-3b91111e0665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:58.443790 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66c0ec-55df-4ad9-8332-3b91111e0665 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:58.455887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1287/2549] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:01:58.460197 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5809df-3c5a-4474-b437-9bede381ada6 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:58.469794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5809df-3c5a-4474-b437-9bede381ada6 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:58.474441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb0421-e8f9-4464-9de9-83b3a0b29b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:58.475083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0421-e8f9-4464-9de9-83b3a0b29b21 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.475362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0421-e8f9-4464-9de9-83b3a0b29b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.475661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0421-e8f9-4464-9de9-83b3a0b29b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.476353 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb0421-e8f9-4464-9de9-83b3a0b29b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:58.478311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb0421-e8f9-4464-9de9-83b3a0b29b21 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:58.514003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1263/2550] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:01:58 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:01:58.518244 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66c0ec-55df-4ad9-8332-3b91111e0665 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:58.528910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66c0ec-55df-4ad9-8332-3b91111e0665 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:58.582387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167edef3-20c6-40f4-b5fc-592998d81731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:58.583045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167edef3-20c6-40f4-b5fc-592998d81731 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.583326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167edef3-20c6-40f4-b5fc-592998d81731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.583597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167edef3-20c6-40f4-b5fc-592998d81731 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.584452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167edef3-20c6-40f4-b5fc-592998d81731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:58.586218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167edef3-20c6-40f4-b5fc-592998d81731 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:58.608253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1288/2551] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:01:58 2022] POST /identity/v3/users => generated 279 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:01:58.612598 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb0421-e8f9-4464-9de9-83b3a0b29b21 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:58.629041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb0421-e8f9-4464-9de9-83b3a0b29b21 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:58.633798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a3410-c4c8-4d4a-a29b-f6e3addc3834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:58.634464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a3410-c4c8-4d4a-a29b-f6e3addc3834 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.634745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a3410-c4c8-4d4a-a29b-f6e3addc3834 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.635207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a3410-c4c8-4d4a-a29b-f6e3addc3834 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.636414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a3410-c4c8-4d4a-a29b-f6e3addc3834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:58.638070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a3410-c4c8-4d4a-a29b-f6e3addc3834 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:58.648570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1264/2552] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:01:58.653143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167edef3-20c6-40f4-b5fc-592998d81731 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:58.664242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167edef3-20c6-40f4-b5fc-592998d81731 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:58.669914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b8c1de-bc9d-49ad-9363-063810301411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:58.670587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8c1de-bc9d-49ad-9363-063810301411 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.670873 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8c1de-bc9d-49ad-9363-063810301411 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.671155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8c1de-bc9d-49ad-9363-063810301411 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.671880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8c1de-bc9d-49ad-9363-063810301411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:58.673495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b8c1de-bc9d-49ad-9363-063810301411 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:58.684368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1289/2553] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 13:01:58.688705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a3410-c4c8-4d4a-a29b-f6e3addc3834 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:58.698691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a3410-c4c8-4d4a-a29b-f6e3addc3834 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:58.703347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a1116-b1a9-4dba-82ac-6c7dc5282689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:58.704226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a1116-b1a9-4dba-82ac-6c7dc5282689 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.704499 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a1116-b1a9-4dba-82ac-6c7dc5282689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.704770 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a1116-b1a9-4dba-82ac-6c7dc5282689 admin admin] PATH_INFO: `/v3/projects/6f87312ac7ae43f1a1c289108e769c59/users/f75a9f84793541548a65b2310a00f4c2/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.721986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a1116-b1a9-4dba-82ac-6c7dc5282689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f87312ac7ae43f1a1c289108e769c59, user_id=f75a9f84793541548a65b2310a00f4c2, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:58.724649 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a1116-b1a9-4dba-82ac-6c7dc5282689 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:58.738741 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1265/2554] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:01:58 2022] PUT /identity/v3/projects/6f87312ac7ae43f1a1c289108e769c59/users/f75a9f84793541548a65b2310a00f4c2/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:01:58.750531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2b06b-b1fa-41a9-9e7c-685160e6f540 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.750818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2b06b-b1fa-41a9-9e7c-685160e6f540 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.751095 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2b06b-b1fa-41a9-9e7c-685160e6f540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.777696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3cb2b06b-b1fa-41a9-9e7c-685160e6f540 None None] MFA Rules not processed for user `f75a9f84793541548a65b2310a00f4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:01:58.778865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3cb2b06b-b1fa-41a9-9e7c-685160e6f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:58.847393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1290/2555] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:01:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:01:58.852830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a1116-b1a9-4dba-82ac-6c7dc5282689 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:58.918511 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a1116-b1a9-4dba-82ac-6c7dc5282689 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:58.923956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c410a8-23bd-4a9f-a078-a177d3ac1bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:58.924425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c410a8-23bd-4a9f-a078-a177d3ac1bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:58.924788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c410a8-23bd-4a9f-a078-a177d3ac1bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:58.925427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c410a8-23bd-4a9f-a078-a177d3ac1bb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:58.925912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c410a8-23bd-4a9f-a078-a177d3ac1bb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:58.928295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c410a8-23bd-4a9f-a078-a177d3ac1bb5 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:58.958987 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1266/2556] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:01:58 2022] POST /identity/v3/projects => generated 357 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:01:58.959970 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2b06b-b1fa-41a9-9e7c-685160e6f540 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:58.972278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2b06b-b1fa-41a9-9e7c-685160e6f540 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:59.032347 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7de74-9852-4632-8f29-1904ac4247a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:59.032916 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7de74-9852-4632-8f29-1904ac4247a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:59.033205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7de74-9852-4632-8f29-1904ac4247a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:59.033480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7de74-9852-4632-8f29-1904ac4247a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:59.034200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7de74-9852-4632-8f29-1904ac4247a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:59.036134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7de74-9852-4632-8f29-1904ac4247a2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:59.056816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1291/2557] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:01:58 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:01:59.061011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c410a8-23bd-4a9f-a078-a177d3ac1bb5 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:59.072047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c410a8-23bd-4a9f-a078-a177d3ac1bb5 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:59.076675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc5d8-9375-4df1-ac60-f4712a367a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:59.077325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc5d8-9375-4df1-ac60-f4712a367a20 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:59.077643 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc5d8-9375-4df1-ac60-f4712a367a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:59.077924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bc5d8-9375-4df1-ac60-f4712a367a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:59.078649 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc5d8-9375-4df1-ac60-f4712a367a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:59.080475 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bc5d8-9375-4df1-ac60-f4712a367a20 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:59.091958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1267/2558] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:01:59.096817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7de74-9852-4632-8f29-1904ac4247a2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:59.107354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7de74-9852-4632-8f29-1904ac4247a2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:59.112045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7a93e-436a-405f-8cf3-caa66d645d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:59.113085 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7a93e-436a-405f-8cf3-caa66d645d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:59.113372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7a93e-436a-405f-8cf3-caa66d645d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:59.113674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7a93e-436a-405f-8cf3-caa66d645d96 admin admin] PATH_INFO: `/v3/projects/a828f30a4eb444059fe44786065a1d3f/users/839b2cf2b6144f47b18a9f591a60008c/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:59.128466 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7a93e-436a-405f-8cf3-caa66d645d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a828f30a4eb444059fe44786065a1d3f, user_id=839b2cf2b6144f47b18a9f591a60008c, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:59.131182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7a93e-436a-405f-8cf3-caa66d645d96 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:59.144557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1292/2559] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:01:59 2022] PUT /identity/v3/projects/a828f30a4eb444059fe44786065a1d3f/users/839b2cf2b6144f47b18a9f591a60008c/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:01:59.148812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc5d8-9375-4df1-ac60-f4712a367a20 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:59.159890 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bc5d8-9375-4df1-ac60-f4712a367a20 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:59.216413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da5094-6256-484d-bb39-faf9cffffe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:59.217080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da5094-6256-484d-bb39-faf9cffffe5f admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:59.217362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da5094-6256-484d-bb39-faf9cffffe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:59.217670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da5094-6256-484d-bb39-faf9cffffe5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:59.218387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da5094-6256-484d-bb39-faf9cffffe5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:59.220064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da5094-6256-484d-bb39-faf9cffffe5f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:59.230081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1268/2560] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:01:59.234387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7a93e-436a-405f-8cf3-caa66d645d96 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:59.244961 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7a93e-436a-405f-8cf3-caa66d645d96 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:59.249709 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6bdba-2990-4da1-862b-beb9e72fa669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:59.250594 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6bdba-2990-4da1-862b-beb9e72fa669 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:59.250874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6bdba-2990-4da1-862b-beb9e72fa669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:59.251143 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6bdba-2990-4da1-862b-beb9e72fa669 admin admin] PATH_INFO: `/v3/projects/a828f30a4eb444059fe44786065a1d3f/users/839b2cf2b6144f47b18a9f591a60008c/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:59.253107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6bdba-2990-4da1-862b-beb9e72fa669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a828f30a4eb444059fe44786065a1d3f, user_id=839b2cf2b6144f47b18a9f591a60008c, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:59.255769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6bdba-2990-4da1-862b-beb9e72fa669 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:59.267697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1293/2561] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:01:59 2022] PUT /identity/v3/projects/a828f30a4eb444059fe44786065a1d3f/users/839b2cf2b6144f47b18a9f591a60008c/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:01:59.278686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eac54-d07f-4ad4-a556-ecb5900e7f73 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:59.278973 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eac54-d07f-4ad4-a556-ecb5900e7f73 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:59.279250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eac54-d07f-4ad4-a556-ecb5900e7f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:59.305408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-df2eac54-d07f-4ad4-a556-ecb5900e7f73 None None] MFA Rules not processed for user `839b2cf2b6144f47b18a9f591a60008c`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:01:59.306570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-df2eac54-d07f-4ad4-a556-ecb5900e7f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:59.379226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1269/2562] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:01:59 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:01:59.391286 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6bdba-2990-4da1-862b-beb9e72fa669 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:59.393008 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bfe6bdba-2990-4da1-862b-beb9e72fa669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:01:59.452917 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6bdba-2990-4da1-862b-beb9e72fa669 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:59.456571 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655e2ca-6144-4d38-8ed3-9eef6a794ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:59.457216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e2ca-6144-4d38-8ed3-9eef6a794ace service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:59.457490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e2ca-6144-4d38-8ed3-9eef6a794ace service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:59.457794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e2ca-6144-4d38-8ed3-9eef6a794ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:59.467865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655e2ca-6144-4d38-8ed3-9eef6a794ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:59.469312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655e2ca-6144-4d38-8ed3-9eef6a794ace service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:59.479906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1294/2563] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:01:59 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:01:59.557390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eac54-d07f-4ad4-a556-ecb5900e7f73 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:01:59.567579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eac54-d07f-4ad4-a556-ecb5900e7f73 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:01:59.571228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d70f63-3e5a-47f6-b3e6-c87e171df5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:01:59.571871 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d70f63-3e5a-47f6-b3e6-c87e171df5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:01:59.572212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d70f63-3e5a-47f6-b3e6-c87e171df5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:01:59.572427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d70f63-3e5a-47f6-b3e6-c87e171df5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:01:59.628615 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d70f63-3e5a-47f6-b3e6-c87e171df5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:01:59.630100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d70f63-3e5a-47f6-b3e6-c87e171df5b5 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:01:59.639090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1270/2564] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:01:59 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:01.361678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655e2ca-6144-4d38-8ed3-9eef6a794ace service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:01.363109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1655e2ca-6144-4d38-8ed3-9eef6a794ace service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:01.422097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655e2ca-6144-4d38-8ed3-9eef6a794ace service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:01.426861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ecb03-621d-4e81-893f-da61b0248a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:01.426861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ecb03-621d-4e81-893f-da61b0248a54 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:01.426861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ecb03-621d-4e81-893f-da61b0248a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:01.427276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ecb03-621d-4e81-893f-da61b0248a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:01.428711 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8d7ecb03-621d-4e81-893f-da61b0248a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:01.492053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ecb03-621d-4e81-893f-da61b0248a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:01.493491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ecb03-621d-4e81-893f-da61b0248a54 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:01.504186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1295/2565] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:03.206599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d70f63-3e5a-47f6-b3e6-c87e171df5b5 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:03.219277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d70f63-3e5a-47f6-b3e6-c87e171df5b5 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:03.224265 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494302b-fd3a-45d3-b23e-ed83fff8773d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:03.225062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494302b-fd3a-45d3-b23e-ed83fff8773d service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:03.225646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494302b-fd3a-45d3-b23e-ed83fff8773d service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:03.226157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494302b-fd3a-45d3-b23e-ed83fff8773d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:03.228296 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6494302b-fd3a-45d3-b23e-ed83fff8773d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:03.317849 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494302b-fd3a-45d3-b23e-ed83fff8773d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:03.319643 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494302b-fd3a-45d3-b23e-ed83fff8773d service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:03.346179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1271/2566] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:05.473529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ecb03-621d-4e81-893f-da61b0248a54 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:05.475320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8d7ecb03-621d-4e81-893f-da61b0248a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:05.487865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ecb03-621d-4e81-893f-da61b0248a54 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:05.492510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:05.493370 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:05.493684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:05.494524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] PATH_INFO: `/v3/users/00d5aeec35784bfb80b431605ef02a8b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:05.495715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d5aeec35784bfb80b431605ef02a8b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:05.497682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:05.547393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d5aeec35784bfb80b431605ef02a8b'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:05.547746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d5aeec35784bfb80b431605ef02a8b'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:05.548353 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d5aeec35784bfb80b431605ef02a8b'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:05.561046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d5aeec35784bfb80b431605ef02a8b'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:05.568457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-7ec9a200-3441-46a5-bd98-516bbf3a8a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d5aeec35784bfb80b431605ef02a8b'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:05.581426 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1296/2567] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:02:05 2022] DELETE /identity/v3/users/00d5aeec35784bfb80b431605ef02a8b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:05.754016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494302b-fd3a-45d3-b23e-ed83fff8773d service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:05.768016 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494302b-fd3a-45d3-b23e-ed83fff8773d service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:05.828812 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:05.829611 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:05.829896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:05.830173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] PATH_INFO: `/v3/projects/3921037165464922bb64cd4fbea35ae0` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:05.831369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3921037165464922bb64cd4fbea35ae0)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:05.833300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:05.881147 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3921037165464922bb64cd4fbea35ae0', 'request_id': 'req-3490621c-968e-44f1-801e-36a418990502'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:05.887361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3921037165464922bb64cd4fbea35ae0', 'request_id': 'req-3490621c-968e-44f1-801e-36a418990502'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:05.895195 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3921037165464922bb64cd4fbea35ae0', 'request_id': 'req-3490621c-968e-44f1-801e-36a418990502'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:05.906527 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] The token cache is being invalidate because project 3921037165464922bb64cd4fbea35ae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:02:05.906811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:05.907532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-3490621c-968e-44f1-801e-36a418990502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:05.909138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1272/2568] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:02:05 2022] DELETE /identity/v3/projects/3921037165464922bb64cd4fbea35ae0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:05.914567 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0997c-8830-4e0d-969a-fab8ecc3e503 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:05.914854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0997c-8830-4e0d-969a-fab8ecc3e503 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:05.915125 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0997c-8830-4e0d-969a-fab8ecc3e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:05.934044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d2a0997c-8830-4e0d-969a-fab8ecc3e503 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:05.935629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d2a0997c-8830-4e0d-969a-fab8ecc3e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:05.998655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1297/2569] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:06.006933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad5d55-821c-4b91-aea1-a4e7563f7fd3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.007212 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad5d55-821c-4b91-aea1-a4e7563f7fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.007488 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad5d55-821c-4b91-aea1-a4e7563f7fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.025596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-7aad5d55-821c-4b91-aea1-a4e7563f7fd3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:06.026822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7aad5d55-821c-4b91-aea1-a4e7563f7fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:06.034820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1273/2570] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:02:06.039329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0997c-8830-4e0d-969a-fab8ecc3e503 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.050222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0997c-8830-4e0d-969a-fab8ecc3e503 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.055284 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37132eb-4740-4417-b747-f8fd0dc52db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.055939 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37132eb-4740-4417-b747-f8fd0dc52db0 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.056278 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37132eb-4740-4417-b747-f8fd0dc52db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.057051 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37132eb-4740-4417-b747-f8fd0dc52db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.057986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37132eb-4740-4417-b747-f8fd0dc52db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:02:06.058343 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37132eb-4740-4417-b747-f8fd0dc52db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.059948 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37132eb-4740-4417-b747-f8fd0dc52db0 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.071854 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1298/2571] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:02:06.076316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad5d55-821c-4b91-aea1-a4e7563f7fd3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.085403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad5d55-821c-4b91-aea1-a4e7563f7fd3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.090176 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa753d-13df-4038-a841-9228cdd086a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.090833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa753d-13df-4038-a841-9228cdd086a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.091110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa753d-13df-4038-a841-9228cdd086a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.091383 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa753d-13df-4038-a841-9228cdd086a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.092098 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa753d-13df-4038-a841-9228cdd086a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.094037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa753d-13df-4038-a841-9228cdd086a0 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.120233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1274/2572] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:02:06 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:06.124622 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37132eb-4740-4417-b747-f8fd0dc52db0 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.134896 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37132eb-4740-4417-b747-f8fd0dc52db0 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.192530 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc2e88-d6a8-40ba-8d9b-923a0b8b6188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.193223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc2e88-d6a8-40ba-8d9b-923a0b8b6188 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.193524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc2e88-d6a8-40ba-8d9b-923a0b8b6188 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.193828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc2e88-d6a8-40ba-8d9b-923a0b8b6188 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.194550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc2e88-d6a8-40ba-8d9b-923a0b8b6188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.196462 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc2e88-d6a8-40ba-8d9b-923a0b8b6188 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.217685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1299/2573] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:02:06 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:06.221822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa753d-13df-4038-a841-9228cdd086a0 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.233134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa753d-13df-4038-a841-9228cdd086a0 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.237941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec24e3-42ca-4c99-b731-cbb1c98f176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.238613 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec24e3-42ca-4c99-b731-cbb1c98f176b admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.238918 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec24e3-42ca-4c99-b731-cbb1c98f176b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.239178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec24e3-42ca-4c99-b731-cbb1c98f176b admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.239911 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec24e3-42ca-4c99-b731-cbb1c98f176b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.241548 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec24e3-42ca-4c99-b731-cbb1c98f176b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.253618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1275/2574] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:06.258075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc2e88-d6a8-40ba-8d9b-923a0b8b6188 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.268415 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc2e88-d6a8-40ba-8d9b-923a0b8b6188 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.273221 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac37cfc-8304-4c3c-bcbf-7ed14717f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.273976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac37cfc-8304-4c3c-bcbf-7ed14717f115 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.274468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac37cfc-8304-4c3c-bcbf-7ed14717f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.274468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac37cfc-8304-4c3c-bcbf-7ed14717f115 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.275847 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac37cfc-8304-4c3c-bcbf-7ed14717f115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.277405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac37cfc-8304-4c3c-bcbf-7ed14717f115 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.287753 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1300/2575] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:06.293286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec24e3-42ca-4c99-b731-cbb1c98f176b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.304081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec24e3-42ca-4c99-b731-cbb1c98f176b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.308948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d437b-6532-4b34-99b2-94a95913121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.309879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d437b-6532-4b34-99b2-94a95913121e admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.310158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d437b-6532-4b34-99b2-94a95913121e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.310463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d437b-6532-4b34-99b2-94a95913121e admin admin] PATH_INFO: `/v3/projects/924d26feebe04edeaa1329e736f46052/users/c73aa158af994ba68f29ae3335d8b23e/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.326500 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d437b-6532-4b34-99b2-94a95913121e admin admin] RBAC: Authorizing `identity:create_grant(project_id=924d26feebe04edeaa1329e736f46052, user_id=c73aa158af994ba68f29ae3335d8b23e, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.329396 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d437b-6532-4b34-99b2-94a95913121e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.343914 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1276/2576] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:06 2022] PUT /identity/v3/projects/924d26feebe04edeaa1329e736f46052/users/c73aa158af994ba68f29ae3335d8b23e/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:06.355071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f5b29-312c-4c8b-92a2-0b6cac549bce None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.355394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f5b29-312c-4c8b-92a2-0b6cac549bce None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.355827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f5b29-312c-4c8b-92a2-0b6cac549bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.384514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-2e4f5b29-312c-4c8b-92a2-0b6cac549bce None None] MFA Rules not processed for user `c73aa158af994ba68f29ae3335d8b23e`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:06.385769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2e4f5b29-312c-4c8b-92a2-0b6cac549bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:06.450568 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1301/2577] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:06.455107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d437b-6532-4b34-99b2-94a95913121e admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.519964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d437b-6532-4b34-99b2-94a95913121e admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.524654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad0208-bd12-4ff3-8924-d90c9ed00ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.525342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad0208-bd12-4ff3-8924-d90c9ed00ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.525652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad0208-bd12-4ff3-8924-d90c9ed00ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.526009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad0208-bd12-4ff3-8924-d90c9ed00ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.526619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad0208-bd12-4ff3-8924-d90c9ed00ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.528538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad0208-bd12-4ff3-8924-d90c9ed00ee2 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.553416 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1277/2578] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:02:06 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:06.558137 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f5b29-312c-4c8b-92a2-0b6cac549bce None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.568809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f5b29-312c-4c8b-92a2-0b6cac549bce None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.627113 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f61b34-e762-4fc3-b6dd-8414b2ad2a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.627789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f61b34-e762-4fc3-b6dd-8414b2ad2a08 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.628073 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f61b34-e762-4fc3-b6dd-8414b2ad2a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.628345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f61b34-e762-4fc3-b6dd-8414b2ad2a08 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.629050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f61b34-e762-4fc3-b6dd-8414b2ad2a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.630998 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f61b34-e762-4fc3-b6dd-8414b2ad2a08 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.652748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1302/2579] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:02:06 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:06.656795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad0208-bd12-4ff3-8924-d90c9ed00ee2 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.672406 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad0208-bd12-4ff3-8924-d90c9ed00ee2 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.678165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6427004-b714-40d4-a89a-0c4232760ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.678878 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427004-b714-40d4-a89a-0c4232760ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.679156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427004-b714-40d4-a89a-0c4232760ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.679474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6427004-b714-40d4-a89a-0c4232760ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.680388 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6427004-b714-40d4-a89a-0c4232760ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.682456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6427004-b714-40d4-a89a-0c4232760ca4 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.701636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1278/2580] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:06.706597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f61b34-e762-4fc3-b6dd-8414b2ad2a08 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.724190 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f61b34-e762-4fc3-b6dd-8414b2ad2a08 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.730337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118963a-aa3d-4e20-aa43-8945a27f886b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.731558 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118963a-aa3d-4e20-aa43-8945a27f886b admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.731974 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118963a-aa3d-4e20-aa43-8945a27f886b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.732595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118963a-aa3d-4e20-aa43-8945a27f886b admin admin] PATH_INFO: `/v3/projects/7d7cae8c01d34d49831ff1cc30e2bf37/users/5f12bb696e3e43caa6373f7b1ff3681c/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.752044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118963a-aa3d-4e20-aa43-8945a27f886b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cae8c01d34d49831ff1cc30e2bf37, user_id=5f12bb696e3e43caa6373f7b1ff3681c, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.755797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118963a-aa3d-4e20-aa43-8945a27f886b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.771694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1303/2581] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:06 2022] PUT /identity/v3/projects/7d7cae8c01d34d49831ff1cc30e2bf37/users/5f12bb696e3e43caa6373f7b1ff3681c/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:02:06.776432 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6427004-b714-40d4-a89a-0c4232760ca4 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.787323 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6427004-b714-40d4-a89a-0c4232760ca4 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.849957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a468394-e23e-4d16-8382-d03cf26db78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.850730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a468394-e23e-4d16-8382-d03cf26db78b admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.850827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a468394-e23e-4d16-8382-d03cf26db78b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.851078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a468394-e23e-4d16-8382-d03cf26db78b admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.851800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a468394-e23e-4d16-8382-d03cf26db78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.854082 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a468394-e23e-4d16-8382-d03cf26db78b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.864805 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1279/2582] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:06.869958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118963a-aa3d-4e20-aa43-8945a27f886b admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:06.882702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118963a-aa3d-4e20-aa43-8945a27f886b admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:06.887897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8073c3d-e5fa-42db-bc69-92209688d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:06.888794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8073c3d-e5fa-42db-bc69-92209688d554 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.889087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8073c3d-e5fa-42db-bc69-92209688d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.889368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8073c3d-e5fa-42db-bc69-92209688d554 admin admin] PATH_INFO: `/v3/projects/7d7cae8c01d34d49831ff1cc30e2bf37/users/5f12bb696e3e43caa6373f7b1ff3681c/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.891417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8073c3d-e5fa-42db-bc69-92209688d554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cae8c01d34d49831ff1cc30e2bf37, user_id=5f12bb696e3e43caa6373f7b1ff3681c, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:06.895029 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8073c3d-e5fa-42db-bc69-92209688d554 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:06.908441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1304/2583] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:06 2022] PUT /identity/v3/projects/7d7cae8c01d34d49831ff1cc30e2bf37/users/5f12bb696e3e43caa6373f7b1ff3681c/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:06.921298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcc99b-89c3-4e65-bc08-2cb88bc42d41 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:06.921688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcc99b-89c3-4e65-bc08-2cb88bc42d41 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:06.921981 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebcc99b-89c3-4e65-bc08-2cb88bc42d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:06.951547 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3ebcc99b-89c3-4e65-bc08-2cb88bc42d41 None None] MFA Rules not processed for user `5f12bb696e3e43caa6373f7b1ff3681c`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:06.952819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3ebcc99b-89c3-4e65-bc08-2cb88bc42d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:07.029337 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1280/2584] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:07.042302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8073c3d-e5fa-42db-bc69-92209688d554 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:07.044179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d8073c3d-e5fa-42db-bc69-92209688d554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:07.106590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8073c3d-e5fa-42db-bc69-92209688d554 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:07.110597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25833f6a-f0da-4642-abc3-87e2831e16d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:07.111247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833f6a-f0da-4642-abc3-87e2831e16d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:07.111529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833f6a-f0da-4642-abc3-87e2831e16d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:07.111801 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25833f6a-f0da-4642-abc3-87e2831e16d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:07.121336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25833f6a-f0da-4642-abc3-87e2831e16d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:07.122829 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25833f6a-f0da-4642-abc3-87e2831e16d0 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:07.134541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1305/2585] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:07.217341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcc99b-89c3-4e65-bc08-2cb88bc42d41 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:07.227917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebcc99b-89c3-4e65-bc08-2cb88bc42d41 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:07.232677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7397-89dc-4249-9892-189f1ec5f206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:07.233537 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7397-89dc-4249-9892-189f1ec5f206 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:07.233972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7397-89dc-4249-9892-189f1ec5f206 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:07.234350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7397-89dc-4249-9892-189f1ec5f206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:07.297701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea7397-89dc-4249-9892-189f1ec5f206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:07.299198 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea7397-89dc-4249-9892-189f1ec5f206 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:07.308806 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1281/2586] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:09.381287 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329abe2c-b5b0-447c-a39b-00e0d10b438e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:09.381979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329abe2c-b5b0-447c-a39b-00e0d10b438e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:09.381979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329abe2c-b5b0-447c-a39b-00e0d10b438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:09.399984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-329abe2c-b5b0-447c-a39b-00e0d10b438e None None] MFA Rules not processed for user `ef623fa30c4647e18d9dd3f81704e0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:09.401722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-329abe2c-b5b0-447c-a39b-00e0d10b438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:09.461954 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1306/2587] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:19.783999 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7397-89dc-4249-9892-189f1ec5f206 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:19.786612 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2aea7397-89dc-4249-9892-189f1ec5f206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:19.925620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7397-89dc-4249-9892-189f1ec5f206 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:19.934311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:19.935857 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:19.936357 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:19.936866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] PATH_INFO: `/v3/users/f75a9f84793541548a65b2310a00f4c2` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:19.939211 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75a9f84793541548a65b2310a00f4c2)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:19.943191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:20.004772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75a9f84793541548a65b2310a00f4c2'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:20.005516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75a9f84793541548a65b2310a00f4c2'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:20.006151 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75a9f84793541548a65b2310a00f4c2'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:20.015269 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75a9f84793541548a65b2310a00f4c2'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:20.029830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75a9f84793541548a65b2310a00f4c2'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:20.048115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1282/2588] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:02:19 2022] DELETE /identity/v3/users/f75a9f84793541548a65b2310a00f4c2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:20.053057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194fa08-1bd8-4d24-a6cd-0cfc585ddc49 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:20.053692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194fa08-1bd8-4d24-a6cd-0cfc585ddc49 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:20.053692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194fa08-1bd8-4d24-a6cd-0cfc585ddc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:20.074435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5194fa08-1bd8-4d24-a6cd-0cfc585ddc49 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:20.075704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5194fa08-1bd8-4d24-a6cd-0cfc585ddc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:20.145672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1307/2589] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:20.155694 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:20.157781 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:20.267311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e2515-9af7-42ac-8efd-39a292b0d30f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:20.273420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360a79c-915b-4dea-8872-9a0aa8de4e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:20.274611 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360a79c-915b-4dea-8872-9a0aa8de4e3e service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:20.275126 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360a79c-915b-4dea-8872-9a0aa8de4e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:20.275621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360a79c-915b-4dea-8872-9a0aa8de4e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:20.293476 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360a79c-915b-4dea-8872-9a0aa8de4e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:20.296374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360a79c-915b-4dea-8872-9a0aa8de4e3e service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:20.315907 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1283/2590] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:20.750560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194fa08-1bd8-4d24-a6cd-0cfc585ddc49 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:20.752317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5194fa08-1bd8-4d24-a6cd-0cfc585ddc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:20.768335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194fa08-1bd8-4d24-a6cd-0cfc585ddc49 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:20.773871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:20.775949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:20.776378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:20.776697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] PATH_INFO: `/v3/projects/6f87312ac7ae43f1a1c289108e769c59` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:20.778771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f87312ac7ae43f1a1c289108e769c59)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:20.782340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:20.856380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f87312ac7ae43f1a1c289108e769c59', 'request_id': 'req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:20.864470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f87312ac7ae43f1a1c289108e769c59', 'request_id': 'req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:20.875522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f87312ac7ae43f1a1c289108e769c59', 'request_id': 'req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:20.891433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] The token cache is being invalidate because project 6f87312ac7ae43f1a1c289108e769c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:02:20.891812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:20.892510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:20.895517 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1308/2591] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:02:20 2022] DELETE /identity/v3/projects/6f87312ac7ae43f1a1c289108e769c59 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:20.902465 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360a79c-915b-4dea-8872-9a0aa8de4e3e service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:20.915525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360a79c-915b-4dea-8872-9a0aa8de4e3e service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:21.012003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:21.013318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:21.014035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:21.017653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] PATH_INFO: `/v3/users/839b2cf2b6144f47b18a9f591a60008c` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:21.017653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=839b2cf2b6144f47b18a9f591a60008c)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:21.020838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:21.121152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839b2cf2b6144f47b18a9f591a60008c'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:21.122479 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839b2cf2b6144f47b18a9f591a60008c'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:21.123467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839b2cf2b6144f47b18a9f591a60008c'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:21.137236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839b2cf2b6144f47b18a9f591a60008c'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:21.160803 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8a93078a-3655-4c3a-8de5-db68892c9d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839b2cf2b6144f47b18a9f591a60008c'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:21.189298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1284/2592] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:02:20 2022] DELETE /identity/v3/users/839b2cf2b6144f47b18a9f591a60008c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:21.641733 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:21.644168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:21.660475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36538ee4-0aca-4c00-9703-e2e8c57ce5a2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:21.742503 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:21.743861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:21.744262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:21.744546 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] PATH_INFO: `/v3/projects/a828f30a4eb444059fe44786065a1d3f` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:21.745992 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a828f30a4eb444059fe44786065a1d3f)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:21.748002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:21.819367 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a828f30a4eb444059fe44786065a1d3f', 'request_id': 'req-fb09e62b-2173-4e72-84ad-32372d2f451f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:21.829393 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a828f30a4eb444059fe44786065a1d3f', 'request_id': 'req-fb09e62b-2173-4e72-84ad-32372d2f451f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:21.839501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a828f30a4eb444059fe44786065a1d3f', 'request_id': 'req-fb09e62b-2173-4e72-84ad-32372d2f451f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:21.852406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] The token cache is being invalidate because project a828f30a4eb444059fe44786065a1d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:02:21.853405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:21.854665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-fb09e62b-2173-4e72-84ad-32372d2f451f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:21.856416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1309/2593] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:02:21 2022] DELETE /identity/v3/projects/a828f30a4eb444059fe44786065a1d3f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:21.861744 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f16ab8-101f-42ab-860b-6f46108b7615 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:21.862064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f16ab8-101f-42ab-860b-6f46108b7615 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:21.862352 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f16ab8-101f-42ab-860b-6f46108b7615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:21.883563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-58f16ab8-101f-42ab-860b-6f46108b7615 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:21.885709 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-58f16ab8-101f-42ab-860b-6f46108b7615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:21.959524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1285/2594] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:21.970450 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29651-576d-4031-be06-1024c3ba9e90 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:21.970751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29651-576d-4031-be06-1024c3ba9e90 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:21.971055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29651-576d-4031-be06-1024c3ba9e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:21.990323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-8eb29651-576d-4031-be06-1024c3ba9e90 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:21.991545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-8eb29651-576d-4031-be06-1024c3ba9e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:22.000676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1310/2595] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:22.005862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f16ab8-101f-42ab-860b-6f46108b7615 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.023025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f16ab8-101f-42ab-860b-6f46108b7615 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.031464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca43c6-8281-4785-af4e-29e7d2b4f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.032597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca43c6-8281-4785-af4e-29e7d2b4f474 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.033117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca43c6-8281-4785-af4e-29e7d2b4f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.033657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca43c6-8281-4785-af4e-29e7d2b4f474 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.035059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca43c6-8281-4785-af4e-29e7d2b4f474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:02:22.035681 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca43c6-8281-4785-af4e-29e7d2b4f474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.039181 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca43c6-8281-4785-af4e-29e7d2b4f474 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:22.061091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1286/2596] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:02:22.065811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29651-576d-4031-be06-1024c3ba9e90 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.076217 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29651-576d-4031-be06-1024c3ba9e90 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.081220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d5e8d-1130-49fa-b52b-c66c4927b78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.081928 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d5e8d-1130-49fa-b52b-c66c4927b78e admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.082214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d5e8d-1130-49fa-b52b-c66c4927b78e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.082490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d5e8d-1130-49fa-b52b-c66c4927b78e admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.083205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d5e8d-1130-49fa-b52b-c66c4927b78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.085136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d5e8d-1130-49fa-b52b-c66c4927b78e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:22.114002 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1311/2597] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:02:22 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 13:02:22.118371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca43c6-8281-4785-af4e-29e7d2b4f474 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.129103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca43c6-8281-4785-af4e-29e7d2b4f474 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.193907 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e0e6-77e3-40d7-a564-2d52a57282a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.194843 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e0e6-77e3-40d7-a564-2d52a57282a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.195294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e0e6-77e3-40d7-a564-2d52a57282a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.195610 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81e0e6-77e3-40d7-a564-2d52a57282a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.196702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81e0e6-77e3-40d7-a564-2d52a57282a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.199078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81e0e6-77e3-40d7-a564-2d52a57282a5 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:22.223001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1287/2598] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:02:22 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 13:02:22.227607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d5e8d-1130-49fa-b52b-c66c4927b78e admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.240372 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d5e8d-1130-49fa-b52b-c66c4927b78e admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.246292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a047630-4b0a-4c6f-890f-b892a568a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.247114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a047630-4b0a-4c6f-890f-b892a568a6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.247427 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a047630-4b0a-4c6f-890f-b892a568a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.247674 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a047630-4b0a-4c6f-890f-b892a568a6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.248406 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a047630-4b0a-4c6f-890f-b892a568a6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.250087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a047630-4b0a-4c6f-890f-b892a568a6c9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:22.262464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1312/2599] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:22.266294 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e0e6-77e3-40d7-a564-2d52a57282a5 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.282523 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81e0e6-77e3-40d7-a564-2d52a57282a5 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.289870 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2632904-074e-452a-acca-a5fb5cf722a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.291489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2632904-074e-452a-acca-a5fb5cf722a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.291772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2632904-074e-452a-acca-a5fb5cf722a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.292048 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2632904-074e-452a-acca-a5fb5cf722a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.293138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2632904-074e-452a-acca-a5fb5cf722a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.296133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2632904-074e-452a-acca-a5fb5cf722a5 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:22.314193 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1288/2600] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:22.317601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a047630-4b0a-4c6f-890f-b892a568a6c9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.334927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a047630-4b0a-4c6f-890f-b892a568a6c9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.341176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1ccb6-6e9e-42c6-9a9d-65591e66e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.342105 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1ccb6-6e9e-42c6-9a9d-65591e66e04c admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.342385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1ccb6-6e9e-42c6-9a9d-65591e66e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.342688 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1ccb6-6e9e-42c6-9a9d-65591e66e04c admin admin] PATH_INFO: `/v3/projects/e670c64c345a45b1b7c708575db97db0/users/168079b1fb90451a89001e4ba08ba23e/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.359811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1ccb6-6e9e-42c6-9a9d-65591e66e04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e670c64c345a45b1b7c708575db97db0, user_id=168079b1fb90451a89001e4ba08ba23e, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.362599 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1ccb6-6e9e-42c6-9a9d-65591e66e04c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:22.382602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1313/2601] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:22 2022] PUT /identity/v3/projects/e670c64c345a45b1b7c708575db97db0/users/168079b1fb90451a89001e4ba08ba23e/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:22.395506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fac44-7cbc-4c6d-90d6-cf7642b024ca None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.395826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fac44-7cbc-4c6d-90d6-cf7642b024ca None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.396110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fac44-7cbc-4c6d-90d6-cf7642b024ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.429817 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-467fac44-7cbc-4c6d-90d6-cf7642b024ca None None] MFA Rules not processed for user `168079b1fb90451a89001e4ba08ba23e`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:22.432036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-467fac44-7cbc-4c6d-90d6-cf7642b024ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:22.504625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1289/2602] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:22.509920 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1ccb6-6e9e-42c6-9a9d-65591e66e04c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.578982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1ccb6-6e9e-42c6-9a9d-65591e66e04c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.588228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43073866-7731-44e2-b479-b45741cb4d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.589276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073866-7731-44e2-b479-b45741cb4d65 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.589783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073866-7731-44e2-b479-b45741cb4d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.590247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43073866-7731-44e2-b479-b45741cb4d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.591434 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43073866-7731-44e2-b479-b45741cb4d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.594826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43073866-7731-44e2-b479-b45741cb4d65 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:22.634523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1314/2603] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:02:22 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:22.639885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fac44-7cbc-4c6d-90d6-cf7642b024ca None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.652962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fac44-7cbc-4c6d-90d6-cf7642b024ca None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.715613 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d5b14-d50b-42aa-88d1-4fa75a77ed67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.716293 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5b14-d50b-42aa-88d1-4fa75a77ed67 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.716576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5b14-d50b-42aa-88d1-4fa75a77ed67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.716850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5b14-d50b-42aa-88d1-4fa75a77ed67 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.717541 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d5b14-d50b-42aa-88d1-4fa75a77ed67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.719520 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d5b14-d50b-42aa-88d1-4fa75a77ed67 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:22.747387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1290/2604] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:02:22 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:22.752522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43073866-7731-44e2-b479-b45741cb4d65 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.770061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43073866-7731-44e2-b479-b45741cb4d65 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.779550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b562cb6-053f-4f7b-bd27-69df0e218777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.780538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b562cb6-053f-4f7b-bd27-69df0e218777 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.781044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b562cb6-053f-4f7b-bd27-69df0e218777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.781545 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b562cb6-053f-4f7b-bd27-69df0e218777 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.783053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b562cb6-053f-4f7b-bd27-69df0e218777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.786307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b562cb6-053f-4f7b-bd27-69df0e218777 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:22.811580 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1315/2605] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:22.813018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d5b14-d50b-42aa-88d1-4fa75a77ed67 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.824691 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d5b14-d50b-42aa-88d1-4fa75a77ed67 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.829521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4f08-4370-44f2-9487-5f5675d1ee5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.830633 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4f08-4370-44f2-9487-5f5675d1ee5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.830968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4f08-4370-44f2-9487-5f5675d1ee5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.831188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4f08-4370-44f2-9487-5f5675d1ee5c admin admin] PATH_INFO: `/v3/projects/3a3eab5d3f9f42a8b3dca8f958503771/users/06ddefb3e219481d995f8d55a56ccf8d/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.850796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc4f08-4370-44f2-9487-5f5675d1ee5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3eab5d3f9f42a8b3dca8f958503771, user_id=06ddefb3e219481d995f8d55a56ccf8d, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.853636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc4f08-4370-44f2-9487-5f5675d1ee5c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:22.871749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1291/2606] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:22 2022] PUT /identity/v3/projects/3a3eab5d3f9f42a8b3dca8f958503771/users/06ddefb3e219481d995f8d55a56ccf8d/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:22.873654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b562cb6-053f-4f7b-bd27-69df0e218777 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:22.893848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b562cb6-053f-4f7b-bd27-69df0e218777 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:22.970771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0816440-2b69-4641-a3c3-be57fd7e4adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:22.972118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816440-2b69-4641-a3c3-be57fd7e4adb admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:22.972536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816440-2b69-4641-a3c3-be57fd7e4adb admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:22.972931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0816440-2b69-4641-a3c3-be57fd7e4adb admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:22.974597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0816440-2b69-4641-a3c3-be57fd7e4adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:22.977607 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0816440-2b69-4641-a3c3-be57fd7e4adb admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:23.000761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1316/2607] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:23.002179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4f08-4370-44f2-9487-5f5675d1ee5c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:23.016103 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4f08-4370-44f2-9487-5f5675d1ee5c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:23.021152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155d71c-bb9b-42af-a18f-fb847b1f9d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:23.022092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155d71c-bb9b-42af-a18f-fb847b1f9d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:23.022434 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155d71c-bb9b-42af-a18f-fb847b1f9d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:23.022827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155d71c-bb9b-42af-a18f-fb847b1f9d44 admin admin] PATH_INFO: `/v3/projects/3a3eab5d3f9f42a8b3dca8f958503771/users/06ddefb3e219481d995f8d55a56ccf8d/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:23.025549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155d71c-bb9b-42af-a18f-fb847b1f9d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3eab5d3f9f42a8b3dca8f958503771, user_id=06ddefb3e219481d995f8d55a56ccf8d, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:23.028563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155d71c-bb9b-42af-a18f-fb847b1f9d44 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:23.040647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1292/2608] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:23 2022] PUT /identity/v3/projects/3a3eab5d3f9f42a8b3dca8f958503771/users/06ddefb3e219481d995f8d55a56ccf8d/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:23.052103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14899c2d-0c21-4741-a204-073b56be5c00 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:23.052432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14899c2d-0c21-4741-a204-073b56be5c00 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:23.052724 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14899c2d-0c21-4741-a204-073b56be5c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:23.081464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-14899c2d-0c21-4741-a204-073b56be5c00 None None] MFA Rules not processed for user `06ddefb3e219481d995f8d55a56ccf8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:23.082636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-14899c2d-0c21-4741-a204-073b56be5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:23.162509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1317/2609] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:23.175573 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155d71c-bb9b-42af-a18f-fb847b1f9d44 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:23.177957 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9155d71c-bb9b-42af-a18f-fb847b1f9d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:23.246833 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155d71c-bb9b-42af-a18f-fb847b1f9d44 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:23.250817 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35798ea-c6a2-4cc9-894f-7118f8a68a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:23.251498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35798ea-c6a2-4cc9-894f-7118f8a68a37 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:23.251794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35798ea-c6a2-4cc9-894f-7118f8a68a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:23.252073 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35798ea-c6a2-4cc9-894f-7118f8a68a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:23.265348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35798ea-c6a2-4cc9-894f-7118f8a68a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:23.266890 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35798ea-c6a2-4cc9-894f-7118f8a68a37 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:23.278210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1293/2610] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:23.377338 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14899c2d-0c21-4741-a204-073b56be5c00 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:23.387746 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14899c2d-0c21-4741-a204-073b56be5c00 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:23.391564 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30481148-b355-4a53-9ea6-30f02896ed8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:23.392218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481148-b355-4a53-9ea6-30f02896ed8f service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:23.392495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481148-b355-4a53-9ea6-30f02896ed8f service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:23.392771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30481148-b355-4a53-9ea6-30f02896ed8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:23.466760 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481148-b355-4a53-9ea6-30f02896ed8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:23.468658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30481148-b355-4a53-9ea6-30f02896ed8f service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:23.485609 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1318/2611] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:26.139657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35798ea-c6a2-4cc9-894f-7118f8a68a37 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:26.209350 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35798ea-c6a2-4cc9-894f-7118f8a68a37 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:26.214959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:26.216509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:26.216791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:26.217057 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] PATH_INFO: `/v3/users/168079b1fb90451a89001e4ba08ba23e` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:26.218342 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] RBAC: Authorizing `identity:delete_user(user_id=168079b1fb90451a89001e4ba08ba23e)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:26.220308 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:26.275015 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '168079b1fb90451a89001e4ba08ba23e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:26.275809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '168079b1fb90451a89001e4ba08ba23e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:26.276446 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '168079b1fb90451a89001e4ba08ba23e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:26.285222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '168079b1fb90451a89001e4ba08ba23e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:26.298972 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '168079b1fb90451a89001e4ba08ba23e'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:26.312566 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1294/2612] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:02:26 2022] DELETE /identity/v3/users/168079b1fb90451a89001e4ba08ba23e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:26.317236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fa603-cdd9-4622-afdf-250e5b320d1c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:26.317838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fa603-cdd9-4622-afdf-250e5b320d1c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:26.317838 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fa603-cdd9-4622-afdf-250e5b320d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:26.335716 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3a0fa603-cdd9-4622-afdf-250e5b320d1c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:26.337550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3a0fa603-cdd9-4622-afdf-250e5b320d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:26.398561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1319/2613] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:26.408889 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:26.410399 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:26.473238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f5406-97ca-4b10-98ec-98c6e098027a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:26.478127 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94619c41-acf6-4b87-a3d9-f6e131ad075b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:26.478829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94619c41-acf6-4b87-a3d9-f6e131ad075b service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:26.479109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94619c41-acf6-4b87-a3d9-f6e131ad075b service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:26.479385 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94619c41-acf6-4b87-a3d9-f6e131ad075b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:26.489204 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94619c41-acf6-4b87-a3d9-f6e131ad075b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:26.490734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94619c41-acf6-4b87-a3d9-f6e131ad075b service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:26.502083 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1295/2614] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:26.840613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fa603-cdd9-4622-afdf-250e5b320d1c None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:26.842524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3a0fa603-cdd9-4622-afdf-250e5b320d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:26.856449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fa603-cdd9-4622-afdf-250e5b320d1c None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:26.861104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:26.862032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:26.862314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:26.862584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] PATH_INFO: `/v3/projects/e670c64c345a45b1b7c708575db97db0` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:26.863792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e670c64c345a45b1b7c708575db97db0)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:26.865880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:26.920041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e670c64c345a45b1b7c708575db97db0', 'request_id': 'req-c3c4375c-fa71-41e5-8742-6121e256d967'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:26.927018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e670c64c345a45b1b7c708575db97db0', 'request_id': 'req-c3c4375c-fa71-41e5-8742-6121e256d967'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:26.937412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e670c64c345a45b1b7c708575db97db0', 'request_id': 'req-c3c4375c-fa71-41e5-8742-6121e256d967'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:26.949321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] The token cache is being invalidate because project e670c64c345a45b1b7c708575db97db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:02:26.949533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:26.950166 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:26.951748 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1320/2615] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:02:26 2022] DELETE /identity/v3/projects/e670c64c345a45b1b7c708575db97db0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:26.956734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94619c41-acf6-4b87-a3d9-f6e131ad075b service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:26.967499 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94619c41-acf6-4b87-a3d9-f6e131ad075b service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:27.042402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:27.043287 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:27.043583 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:27.043864 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] PATH_INFO: `/v3/users/06ddefb3e219481d995f8d55a56ccf8d` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:27.045088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ddefb3e219481d995f8d55a56ccf8d)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:27.047093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:27.107248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ddefb3e219481d995f8d55a56ccf8d'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:27.109497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ddefb3e219481d995f8d55a56ccf8d'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:27.110879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ddefb3e219481d995f8d55a56ccf8d'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:27.121050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ddefb3e219481d995f8d55a56ccf8d'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:27.135391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-040e2ebf-745a-4088-9e48-4f752549d313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ddefb3e219481d995f8d55a56ccf8d'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:27.155216 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1296/2616] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:02:26 2022] DELETE /identity/v3/users/06ddefb3e219481d995f8d55a56ccf8d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:27.489342 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:27.490902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:27.514078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4375c-fa71-41e5-8742-6121e256d967 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:27.575039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:27.575941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:27.576224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:27.576500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] PATH_INFO: `/v3/projects/3a3eab5d3f9f42a8b3dca8f958503771` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:27.577817 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3eab5d3f9f42a8b3dca8f958503771)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:27.580100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:27.638792 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3eab5d3f9f42a8b3dca8f958503771', 'request_id': 'req-a217a162-40bb-4ab3-b219-0e95af0d5015'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:27.646433 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3eab5d3f9f42a8b3dca8f958503771', 'request_id': 'req-a217a162-40bb-4ab3-b219-0e95af0d5015'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:27.656118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3eab5d3f9f42a8b3dca8f958503771', 'request_id': 'req-a217a162-40bb-4ab3-b219-0e95af0d5015'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:27.668010 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] The token cache is being invalidate because project 3a3eab5d3f9f42a8b3dca8f958503771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:02:27.668344 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:27.668993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a217a162-40bb-4ab3-b219-0e95af0d5015 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:27.670669 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1321/2617] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:02:27 2022] DELETE /identity/v3/projects/3a3eab5d3f9f42a8b3dca8f958503771 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:02:27.677798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2b299-eff3-45e6-b6a8-2e7e7aa87e47 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:27.678303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2b299-eff3-45e6-b6a8-2e7e7aa87e47 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:27.678793 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2b299-eff3-45e6-b6a8-2e7e7aa87e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:27.706529 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-ccc2b299-eff3-45e6-b6a8-2e7e7aa87e47 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:27.707769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ccc2b299-eff3-45e6-b6a8-2e7e7aa87e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:27.779742 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1297/2618] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:27.789004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea375d-a571-465a-a23d-b61fb3ab5179 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:27.789288 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea375d-a571-465a-a23d-b61fb3ab5179 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:27.789613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea375d-a571-465a-a23d-b61fb3ab5179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:27.809394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-75ea375d-a571-465a-a23d-b61fb3ab5179 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:27.810682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-75ea375d-a571-465a-a23d-b61fb3ab5179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:27.818827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1322/2619] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:27.823091 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2b299-eff3-45e6-b6a8-2e7e7aa87e47 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:27.832879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2b299-eff3-45e6-b6a8-2e7e7aa87e47 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:27.838278 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b47c76-799a-49a5-ad08-5b3db244ec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:27.839018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b47c76-799a-49a5-ad08-5b3db244ec3c admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:27.839306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b47c76-799a-49a5-ad08-5b3db244ec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:27.839580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b47c76-799a-49a5-ad08-5b3db244ec3c admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:27.840310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b47c76-799a-49a5-ad08-5b3db244ec3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:02:27.840614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b47c76-799a-49a5-ad08-5b3db244ec3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:27.842280 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b47c76-799a-49a5-ad08-5b3db244ec3c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:27.858688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1298/2620] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:02:27.859931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea375d-a571-465a-a23d-b61fb3ab5179 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:27.870045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea375d-a571-465a-a23d-b61fb3ab5179 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:27.874930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd17e19-2bda-4f3e-95b9-da334dae6205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:27.875589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd17e19-2bda-4f3e-95b9-da334dae6205 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:27.875868 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd17e19-2bda-4f3e-95b9-da334dae6205 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:27.876136 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd17e19-2bda-4f3e-95b9-da334dae6205 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:27.876837 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd17e19-2bda-4f3e-95b9-da334dae6205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:27.878835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd17e19-2bda-4f3e-95b9-da334dae6205 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:27.907412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1323/2621] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:02:27 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:27.911728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b47c76-799a-49a5-ad08-5b3db244ec3c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:27.926071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b47c76-799a-49a5-ad08-5b3db244ec3c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:27.987373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5b05-742a-4caf-b15e-bd5eb0c71bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:27.988053 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5b05-742a-4caf-b15e-bd5eb0c71bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:27.988353 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5b05-742a-4caf-b15e-bd5eb0c71bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:27.988689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5b05-742a-4caf-b15e-bd5eb0c71bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:27.989397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5b05-742a-4caf-b15e-bd5eb0c71bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:27.991382 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5b05-742a-4caf-b15e-bd5eb0c71bd4 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:28.014177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1299/2622] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:02:27 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:28.019214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd17e19-2bda-4f3e-95b9-da334dae6205 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:28.030183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd17e19-2bda-4f3e-95b9-da334dae6205 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:28.035030 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f13c9-b3ac-4a2f-9a32-a2025df3e1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:28.035697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f13c9-b3ac-4a2f-9a32-a2025df3e1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:28.035981 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f13c9-b3ac-4a2f-9a32-a2025df3e1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:28.036254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f13c9-b3ac-4a2f-9a32-a2025df3e1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:28.036983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f13c9-b3ac-4a2f-9a32-a2025df3e1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:28.038877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f13c9-b3ac-4a2f-9a32-a2025df3e1d1 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:28.049441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1324/2623] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:28.053539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5b05-742a-4caf-b15e-bd5eb0c71bd4 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:28.063735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5b05-742a-4caf-b15e-bd5eb0c71bd4 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:28.068550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43284262-c4d2-4d6c-ac2e-8b146a05823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:28.069206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284262-c4d2-4d6c-ac2e-8b146a05823f admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:28.069485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284262-c4d2-4d6c-ac2e-8b146a05823f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:28.069786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43284262-c4d2-4d6c-ac2e-8b146a05823f admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:28.070539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43284262-c4d2-4d6c-ac2e-8b146a05823f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:28.072682 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43284262-c4d2-4d6c-ac2e-8b146a05823f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:28.082725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1300/2624] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:28.087762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f13c9-b3ac-4a2f-9a32-a2025df3e1d1 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:28.098059 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f13c9-b3ac-4a2f-9a32-a2025df3e1d1 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:28.103259 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac10ffe-74da-4bc2-b602-c5d610a700dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:28.104219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10ffe-74da-4bc2-b602-c5d610a700dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:28.104504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10ffe-74da-4bc2-b602-c5d610a700dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:28.104779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac10ffe-74da-4bc2-b602-c5d610a700dd admin admin] PATH_INFO: `/v3/projects/ba4b83f156e043b1a4c584dc32ff2f9d/users/40e91f343b8f4e3ca14f4efe17b3fb79/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:28.120971 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac10ffe-74da-4bc2-b602-c5d610a700dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4b83f156e043b1a4c584dc32ff2f9d, user_id=40e91f343b8f4e3ca14f4efe17b3fb79, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:28.123771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac10ffe-74da-4bc2-b602-c5d610a700dd admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:28.138377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1325/2625] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:28 2022] PUT /identity/v3/projects/ba4b83f156e043b1a4c584dc32ff2f9d/users/40e91f343b8f4e3ca14f4efe17b3fb79/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:28.150093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1176aa-ee9f-46dd-941a-0d858a7e8fe0 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:28.150583 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1176aa-ee9f-46dd-941a-0d858a7e8fe0 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:28.150931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1176aa-ee9f-46dd-941a-0d858a7e8fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:28.179442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-5a1176aa-ee9f-46dd-941a-0d858a7e8fe0 None None] MFA Rules not processed for user `40e91f343b8f4e3ca14f4efe17b3fb79`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:28.180845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-5a1176aa-ee9f-46dd-941a-0d858a7e8fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:28.266865 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1301/2626] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:28.278960 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac10ffe-74da-4bc2-b602-c5d610a700dd admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:28.280779 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-bac10ffe-74da-4bc2-b602-c5d610a700dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:28.351397 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac10ffe-74da-4bc2-b602-c5d610a700dd admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:28.355777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5338a-f707-432e-b3c3-9f250cb278f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:28.356528 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5338a-f707-432e-b3c3-9f250cb278f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:28.356741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5338a-f707-432e-b3c3-9f250cb278f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:28.357022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5338a-f707-432e-b3c3-9f250cb278f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:28.368870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5338a-f707-432e-b3c3-9f250cb278f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:28.370419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5338a-f707-432e-b3c3-9f250cb278f2 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:28.379973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1326/2627] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:43.566265 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1176aa-ee9f-46dd-941a-0d858a7e8fe0 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:43.567728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-5a1176aa-ee9f-46dd-941a-0d858a7e8fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:43.637370 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1176aa-ee9f-46dd-941a-0d858a7e8fe0 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:43.642752 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2782c-fadd-4e3e-8b79-11d5a36d3458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:43.643467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2782c-fadd-4e3e-8b79-11d5a36d3458 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:43.643838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2782c-fadd-4e3e-8b79-11d5a36d3458 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:43.644101 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2782c-fadd-4e3e-8b79-11d5a36d3458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:43.647082 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-01e2782c-fadd-4e3e-8b79-11d5a36d3458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:43.719919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2782c-fadd-4e3e-8b79-11d5a36d3458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:43.721689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2782c-fadd-4e3e-8b79-11d5a36d3458 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:43.732661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1302/2628] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:53.550040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5338a-f707-432e-b3c3-9f250cb278f2 service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:53.564023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5338a-f707-432e-b3c3-9f250cb278f2 service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:53.568243 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09df5e-69e4-402c-86f1-e08078e57a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:53.568984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09df5e-69e4-402c-86f1-e08078e57a4c service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:53.569273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09df5e-69e4-402c-86f1-e08078e57a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:53.569550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09df5e-69e4-402c-86f1-e08078e57a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:53.572299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-cb09df5e-69e4-402c-86f1-e08078e57a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:53.645104 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09df5e-69e4-402c-86f1-e08078e57a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:53.647016 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb09df5e-69e4-402c-86f1-e08078e57a4c service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:53.658110 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1327/2629] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:54.918545 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2782c-fadd-4e3e-8b79-11d5a36d3458 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:54.931030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2782c-fadd-4e3e-8b79-11d5a36d3458 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:54.936014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:54.937319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:54.937887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:54.938230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] PATH_INFO: `/v3/users/40e91f343b8f4e3ca14f4efe17b3fb79` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:54.939685 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40e91f343b8f4e3ca14f4efe17b3fb79)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:54.941839 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:55.008487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40e91f343b8f4e3ca14f4efe17b3fb79'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:55.009166 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40e91f343b8f4e3ca14f4efe17b3fb79'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:55.010528 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40e91f343b8f4e3ca14f4efe17b3fb79'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:55.019200 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40e91f343b8f4e3ca14f4efe17b3fb79'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:55.035365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40e91f343b8f4e3ca14f4efe17b3fb79'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:55.063155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1303/2630] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:02:54 2022] DELETE /identity/v3/users/40e91f343b8f4e3ca14f4efe17b3fb79 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:55.065773 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17314-823e-402e-91f8-a05736299a90 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:55.066228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17314-823e-402e-91f8-a05736299a90 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:55.066637 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17314-823e-402e-91f8-a05736299a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:55.088046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-f8b17314-823e-402e-91f8-a05736299a90 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:55.089510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f8b17314-823e-402e-91f8-a05736299a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:55.160492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1328/2631] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:02:55.171423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:55.173945 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:55.240999 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec4803-1c31-4ab5-9aeb-2ad3d142d755 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:55.246071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd66266-48f3-459a-b78a-6086cf099e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:55.246856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd66266-48f3-459a-b78a-6086cf099e2d service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:55.247229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd66266-48f3-459a-b78a-6086cf099e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:55.247594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd66266-48f3-459a-b78a-6086cf099e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:55.259309 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd66266-48f3-459a-b78a-6086cf099e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:55.260890 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd66266-48f3-459a-b78a-6086cf099e2d service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:55.275633 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1304/2632] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:55.802740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b17314-823e-402e-91f8-a05736299a90 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:55.805769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-f8b17314-823e-402e-91f8-a05736299a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:55.834326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b17314-823e-402e-91f8-a05736299a90 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:55.847735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:55.848812 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:55.849158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:55.849548 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] PATH_INFO: `/v3/projects/ba4b83f156e043b1a4c584dc32ff2f9d` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:55.851440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4b83f156e043b1a4c584dc32ff2f9d)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:55.856215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:55.945953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4b83f156e043b1a4c584dc32ff2f9d', 'request_id': 'req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:55.957408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4b83f156e043b1a4c584dc32ff2f9d', 'request_id': 'req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:55.975296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4b83f156e043b1a4c584dc32ff2f9d', 'request_id': 'req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:55.988516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] The token cache is being invalidate because project ba4b83f156e043b1a4c584dc32ff2f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:02:55.988808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:55.989471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:55.991646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1329/2633] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:02:55 2022] DELETE /identity/v3/projects/ba4b83f156e043b1a4c584dc32ff2f9d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:56.002219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853d5a-ac27-4353-99e0-71b23cec9a9e None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:56.002768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853d5a-ac27-4353-99e0-71b23cec9a9e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:56.003251 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b853d5a-ac27-4353-99e0-71b23cec9a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:56.062384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-6b853d5a-ac27-4353-99e0-71b23cec9a9e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:56.064018 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6b853d5a-ac27-4353-99e0-71b23cec9a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:56.105605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:56.107889 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:56.262871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbfd2a-08c5-4c8c-ba87-c3fcf0883a97 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:56.267081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1305/2634] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:56.277979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:56.277979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:56.277979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:56.278424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] PATH_INFO: `/v3/users/c73aa158af994ba68f29ae3335d8b23e` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:56.280663 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73aa158af994ba68f29ae3335d8b23e)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:56.284804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97cfa-4947-43f1-bfe3-5a89c5557713 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:56.285621 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97cfa-4947-43f1-bfe3-5a89c5557713 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:56.286396 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f97cfa-4947-43f1-bfe3-5a89c5557713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:56.292713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:56.336702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-86f97cfa-4947-43f1-bfe3-5a89c5557713 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:56.339352 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-86f97cfa-4947-43f1-bfe3-5a89c5557713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:56.362038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1306/2635] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:02:56.370107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97cfa-4947-43f1-bfe3-5a89c5557713 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:56.390590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f97cfa-4947-43f1-bfe3-5a89c5557713 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:56.418256 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4416121-c269-48ff-b772-2815e486ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:56.419300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4416121-c269-48ff-b772-2815e486ef26 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:56.419760 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4416121-c269-48ff-b772-2815e486ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:56.420217 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4416121-c269-48ff-b772-2815e486ef26 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:56.421493 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4416121-c269-48ff-b772-2815e486ef26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:02:56.422041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4416121-c269-48ff-b772-2815e486ef26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:56.424831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4416121-c269-48ff-b772-2815e486ef26 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:56.424986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73aa158af994ba68f29ae3335d8b23e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:56.428481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73aa158af994ba68f29ae3335d8b23e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:56.430488 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73aa158af994ba68f29ae3335d8b23e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:56.455855 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73aa158af994ba68f29ae3335d8b23e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:56.470417 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-41b1bc02-c157-4001-aa53-c2ebb98b18dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73aa158af994ba68f29ae3335d8b23e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:56.473692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1307/2636] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:02:56.478887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4416121-c269-48ff-b772-2815e486ef26 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:56.484931 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e4416121-c269-48ff-b772-2815e486ef26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:56.505527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1330/2637] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:02:56 2022] DELETE /identity/v3/users/c73aa158af994ba68f29ae3335d8b23e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:02:56.511890 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411a3eb-1bcf-48ec-975a-63dff4be7a34 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:56.512828 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411a3eb-1bcf-48ec-975a-63dff4be7a34 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:56.513877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411a3eb-1bcf-48ec-975a-63dff4be7a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:56.521037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4416121-c269-48ff-b772-2815e486ef26 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:56.547377 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-6411a3eb-1bcf-48ec-975a-63dff4be7a34 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:56.550270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6411a3eb-1bcf-48ec-975a-63dff4be7a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:56.670740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926bab3-4f30-4218-9d8d-eb7daee1f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:56.672118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926bab3-4f30-4218-9d8d-eb7daee1f30a admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:56.672653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926bab3-4f30-4218-9d8d-eb7daee1f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:56.674542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926bab3-4f30-4218-9d8d-eb7daee1f30a admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:56.677863 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926bab3-4f30-4218-9d8d-eb7daee1f30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:56.684505 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926bab3-4f30-4218-9d8d-eb7daee1f30a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:56.687214 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1331/2638] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:02:56.702256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411a3eb-1bcf-48ec-975a-63dff4be7a34 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:56.704320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-6411a3eb-1bcf-48ec-975a-63dff4be7a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:56.751967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1308/2639] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:02:56 2022] POST /identity/v3/projects => generated 371 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:56.756626 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926bab3-4f30-4218-9d8d-eb7daee1f30a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:56.784822 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411a3eb-1bcf-48ec-975a-63dff4be7a34 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:56.844835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926bab3-4f30-4218-9d8d-eb7daee1f30a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:56.847105 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683edd9-138d-45be-98c1-3cea696771e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:56.848378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683edd9-138d-45be-98c1-3cea696771e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:56.848378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683edd9-138d-45be-98c1-3cea696771e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:56.848692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683edd9-138d-45be-98c1-3cea696771e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:56.850104 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10968c-63a5-409e-82fe-410e18afff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:56.850905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10968c-63a5-409e-82fe-410e18afff1f admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:56.851481 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10968c-63a5-409e-82fe-410e18afff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:56.851869 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10968c-63a5-409e-82fe-410e18afff1f admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:56.852754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10968c-63a5-409e-82fe-410e18afff1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:56.854927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10968c-63a5-409e-82fe-410e18afff1f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:56.860770 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683edd9-138d-45be-98c1-3cea696771e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:56.862416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683edd9-138d-45be-98c1-3cea696771e9 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:56.876747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1332/2640] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:56.885632 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1309/2641] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:02:56 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 13:02:56.888056 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683edd9-138d-45be-98c1-3cea696771e9 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:56.899794 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683edd9-138d-45be-98c1-3cea696771e9 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:56.905793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35718446-6f2c-449b-8939-92a3658a33a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:56.906814 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35718446-6f2c-449b-8939-92a3658a33a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:56.907253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35718446-6f2c-449b-8939-92a3658a33a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:56.907560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35718446-6f2c-449b-8939-92a3658a33a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:56.908297 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35718446-6f2c-449b-8939-92a3658a33a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:56.909968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35718446-6f2c-449b-8939-92a3658a33a8 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:56.924479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1333/2642] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 13:02:56.930478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10968c-63a5-409e-82fe-410e18afff1f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:56.950169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10968c-63a5-409e-82fe-410e18afff1f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:56.958984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2013f-4f9a-42a5-9874-b03336c65808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:56.960043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2013f-4f9a-42a5-9874-b03336c65808 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:56.960555 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2013f-4f9a-42a5-9874-b03336c65808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:56.962991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2013f-4f9a-42a5-9874-b03336c65808 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:56.964483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2013f-4f9a-42a5-9874-b03336c65808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:56.967778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2013f-4f9a-42a5-9874-b03336c65808 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:56.987587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1310/2643] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:56.992518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35718446-6f2c-449b-8939-92a3658a33a8 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:57.005682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35718446-6f2c-449b-8939-92a3658a33a8 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:57.011234 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1736e9-0990-48dd-b415-eddc988b83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:57.012270 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1736e9-0990-48dd-b415-eddc988b83d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:57.012553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1736e9-0990-48dd-b415-eddc988b83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:57.012824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1736e9-0990-48dd-b415-eddc988b83d3 admin admin] PATH_INFO: `/v3/projects/dc6eaf4f88fd4a89992c9da46e800300/users/6366e70bc13f4f4ea751d9f5dd6020b2/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:57.065531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1736e9-0990-48dd-b415-eddc988b83d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6eaf4f88fd4a89992c9da46e800300, user_id=6366e70bc13f4f4ea751d9f5dd6020b2, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:57.068319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1736e9-0990-48dd-b415-eddc988b83d3 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:57.092203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1334/2644] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:56 2022] PUT /identity/v3/projects/dc6eaf4f88fd4a89992c9da46e800300/users/6366e70bc13f4f4ea751d9f5dd6020b2/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:57.104491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fefcc-c47e-4caf-9fd0-e19dec61b91f None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:57.105017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fefcc-c47e-4caf-9fd0-e19dec61b91f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:57.105128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fefcc-c47e-4caf-9fd0-e19dec61b91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:57.141341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-582fefcc-c47e-4caf-9fd0-e19dec61b91f None None] MFA Rules not processed for user `6366e70bc13f4f4ea751d9f5dd6020b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:57.143114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-582fefcc-c47e-4caf-9fd0-e19dec61b91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:57.241373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1311/2645] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:57.269904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1736e9-0990-48dd-b415-eddc988b83d3 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:57.273983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-fc1736e9-0990-48dd-b415-eddc988b83d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:57.290386 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fefcc-c47e-4caf-9fd0-e19dec61b91f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:57.292424 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-582fefcc-c47e-4caf-9fd0-e19dec61b91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:57.365621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1736e9-0990-48dd-b415-eddc988b83d3 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:57.370044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88672-2fc1-4ad0-9623-910bc53f8cb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7330a81c0f3a496ea29ae911fcc69221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:57.370708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88672-2fc1-4ad0-9623-910bc53f8cb8 service glance] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:57.371186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88672-2fc1-4ad0-9623-910bc53f8cb8 service glance] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:57.371522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88672-2fc1-4ad0-9623-910bc53f8cb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:57.382018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a88672-2fc1-4ad0-9623-910bc53f8cb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:57.384038 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a88672-2fc1-4ad0-9623-910bc53f8cb8 service glance] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:57.387487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fefcc-c47e-4caf-9fd0-e19dec61b91f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:57.392247 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:57.393109 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:57.393394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:57.393708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] PATH_INFO: `/v3/projects/924d26feebe04edeaa1329e736f46052` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:57.394697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1335/2646] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:02:57.394919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=924d26feebe04edeaa1329e736f46052)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:57.396944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:57.459879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924d26feebe04edeaa1329e736f46052', 'request_id': 'req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:57.467938 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924d26feebe04edeaa1329e736f46052', 'request_id': 'req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:57.479370 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924d26feebe04edeaa1329e736f46052', 'request_id': 'req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:57.506202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] The token cache is being invalidate because project 924d26feebe04edeaa1329e736f46052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:02:57.507409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:57.508377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:57.515424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88672-2fc1-4ad0-9623-910bc53f8cb8 service glance] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:57.515993 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1312/2647] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:02:57 2022] DELETE /identity/v3/projects/924d26feebe04edeaa1329e736f46052 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:57.552471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88672-2fc1-4ad0-9623-910bc53f8cb8 service glance] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:57.686063 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:57.687373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:57.688604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:57.689111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] PATH_INFO: `/v3/users/5f12bb696e3e43caa6373f7b1ff3681c` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:57.690874 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f12bb696e3e43caa6373f7b1ff3681c)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:57.693602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:57.769248 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f12bb696e3e43caa6373f7b1ff3681c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:57.769989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f12bb696e3e43caa6373f7b1ff3681c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:57.770651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f12bb696e3e43caa6373f7b1ff3681c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:57.786199 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f12bb696e3e43caa6373f7b1ff3681c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:57.799507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c391b9d9-7893-442a-837d-0780d3bf61a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f12bb696e3e43caa6373f7b1ff3681c'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:57.818524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1336/2648] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:02:57 2022] DELETE /identity/v3/users/5f12bb696e3e43caa6373f7b1ff3681c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:58.405021 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:58.406973 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:58.422767 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab537-82fb-4b8d-8645-bcff4e4dcddb admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:58.525565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:58.526521 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:58.526822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:58.527081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] PATH_INFO: `/v3/projects/7d7cae8c01d34d49831ff1cc30e2bf37` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:58.528761 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7cae8c01d34d49831ff1cc30e2bf37)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:58.532073 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:58.594819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7cae8c01d34d49831ff1cc30e2bf37', 'request_id': 'req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:58.600705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7cae8c01d34d49831ff1cc30e2bf37', 'request_id': 'req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:58.612431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7cae8c01d34d49831ff1cc30e2bf37', 'request_id': 'req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:58.630114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] The token cache is being invalidate because project 7d7cae8c01d34d49831ff1cc30e2bf37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:02:58.630114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:58.631180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-b829f5b3-01f5-4546-ab7c-9fe656fdbd18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:02:58.634204 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1313/2649] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:02:58 2022] DELETE /identity/v3/projects/7d7cae8c01d34d49831ff1cc30e2bf37 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:58.641916 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4603-c989-4dca-90e5-9fa9315056d1 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:58.642537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4603-c989-4dca-90e5-9fa9315056d1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:58.643011 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4603-c989-4dca-90e5-9fa9315056d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:58.670470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-887c4603-c989-4dca-90e5-9fa9315056d1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:58.671783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-887c4603-c989-4dca-90e5-9fa9315056d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:58.752235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1337/2650] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:58.760896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288dda-1158-4b99-b406-333f66d64feb None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:58.761189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288dda-1158-4b99-b406-333f66d64feb None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:58.761442 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2288dda-1158-4b99-b406-333f66d64feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:58.781992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-f2288dda-1158-4b99-b406-333f66d64feb None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:58.783245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f2288dda-1158-4b99-b406-333f66d64feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:58.793540 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1314/2651] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:58.798680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4603-c989-4dca-90e5-9fa9315056d1 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:58.811269 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4603-c989-4dca-90e5-9fa9315056d1 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:58.817330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0da8b7-7120-499d-8885-28307d458eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:58.818287 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0da8b7-7120-499d-8885-28307d458eda admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:58.818765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0da8b7-7120-499d-8885-28307d458eda admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:58.821117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0da8b7-7120-499d-8885-28307d458eda admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:58.822119 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0da8b7-7120-499d-8885-28307d458eda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:02:58.822745 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0da8b7-7120-499d-8885-28307d458eda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:58.824786 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0da8b7-7120-499d-8885-28307d458eda admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:58.844390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1338/2652] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:02:58.848762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288dda-1158-4b99-b406-333f66d64feb None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:58.860534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2288dda-1158-4b99-b406-333f66d64feb None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:58.866829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdcc59-8f83-43f7-904a-e966c9370776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:58.867719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdcc59-8f83-43f7-904a-e966c9370776 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:58.867838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdcc59-8f83-43f7-904a-e966c9370776 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:58.868085 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdcc59-8f83-43f7-904a-e966c9370776 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:58.868817 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdcc59-8f83-43f7-904a-e966c9370776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:58.871891 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdcc59-8f83-43f7-904a-e966c9370776 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:58.903141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1315/2653] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:02:58 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:58.907858 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0da8b7-7120-499d-8885-28307d458eda admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:58.918752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0da8b7-7120-499d-8885-28307d458eda admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:58.982394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a8eb6-d4b5-4b86-8728-a113ecd8c13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:58.983087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a8eb6-d4b5-4b86-8728-a113ecd8c13a admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:58.983365 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a8eb6-d4b5-4b86-8728-a113ecd8c13a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:58.983633 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a8eb6-d4b5-4b86-8728-a113ecd8c13a admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:58.984331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a8eb6-d4b5-4b86-8728-a113ecd8c13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:58.986330 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a8eb6-d4b5-4b86-8728-a113ecd8c13a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:59.012201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1339/2654] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:02:58 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:59.013804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdcc59-8f83-43f7-904a-e966c9370776 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:59.026790 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdcc59-8f83-43f7-904a-e966c9370776 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:59.031978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bd360-50e1-48da-898f-4ee75d786aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:59.032659 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bd360-50e1-48da-898f-4ee75d786aaa admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.032950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bd360-50e1-48da-898f-4ee75d786aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.033230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bd360-50e1-48da-898f-4ee75d786aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.034003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bd360-50e1-48da-898f-4ee75d786aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:59.035754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bd360-50e1-48da-898f-4ee75d786aaa admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:59.052579 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1316/2655] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:59.053833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a8eb6-d4b5-4b86-8728-a113ecd8c13a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:59.068605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a8eb6-d4b5-4b86-8728-a113ecd8c13a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:59.074264 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a720d92-e572-4b0d-b789-1deec3042455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:59.074940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720d92-e572-4b0d-b789-1deec3042455 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.075220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720d92-e572-4b0d-b789-1deec3042455 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.075489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a720d92-e572-4b0d-b789-1deec3042455 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.076224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720d92-e572-4b0d-b789-1deec3042455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:59.078103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a720d92-e572-4b0d-b789-1deec3042455 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:59.090718 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1340/2656] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:59.095898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bd360-50e1-48da-898f-4ee75d786aaa admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:59.108837 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bd360-50e1-48da-898f-4ee75d786aaa admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:59.113822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7937-f50e-4e89-9a64-2ea9d8ff218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:59.114719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7937-f50e-4e89-9a64-2ea9d8ff218a admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.115006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7937-f50e-4e89-9a64-2ea9d8ff218a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.115284 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b7937-f50e-4e89-9a64-2ea9d8ff218a admin admin] PATH_INFO: `/v3/projects/97426c253f39443cbe2e917e990fa897/users/0b069043ec334a1c8492bfb2af90baae/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.131933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b7937-f50e-4e89-9a64-2ea9d8ff218a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97426c253f39443cbe2e917e990fa897, user_id=0b069043ec334a1c8492bfb2af90baae, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:59.135113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b7937-f50e-4e89-9a64-2ea9d8ff218a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:59.152845 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1317/2657] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:59 2022] PUT /identity/v3/projects/97426c253f39443cbe2e917e990fa897/users/0b069043ec334a1c8492bfb2af90baae/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:59.165731 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433842-50e4-4ff3-b083-b797c31892c4 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.166350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433842-50e4-4ff3-b083-b797c31892c4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.166664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433842-50e4-4ff3-b083-b797c31892c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.202276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-e7433842-50e4-4ff3-b083-b797c31892c4 None None] MFA Rules not processed for user `0b069043ec334a1c8492bfb2af90baae`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:59.203533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e7433842-50e4-4ff3-b083-b797c31892c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:59.276826 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1341/2658] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:59.282205 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7937-f50e-4e89-9a64-2ea9d8ff218a admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:59.364587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b7937-f50e-4e89-9a64-2ea9d8ff218a admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:59.370779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6be72b-198a-4131-8bed-a25b79587cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:59.371474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6be72b-198a-4131-8bed-a25b79587cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.371754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6be72b-198a-4131-8bed-a25b79587cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.372030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6be72b-198a-4131-8bed-a25b79587cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.372743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6be72b-198a-4131-8bed-a25b79587cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:59.374844 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6be72b-198a-4131-8bed-a25b79587cc7 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:59.407595 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1318/2659] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:02:59 2022] POST /identity/v3/projects => generated 361 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:59.413114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7433842-50e4-4ff3-b083-b797c31892c4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:59.432895 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7433842-50e4-4ff3-b083-b797c31892c4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:59.507315 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ef43e-2b1e-4cd8-b222-98459f1155de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:59.508648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ef43e-2b1e-4cd8-b222-98459f1155de admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.508930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ef43e-2b1e-4cd8-b222-98459f1155de admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.509205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ef43e-2b1e-4cd8-b222-98459f1155de admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.509977 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ef43e-2b1e-4cd8-b222-98459f1155de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:59.512233 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ef43e-2b1e-4cd8-b222-98459f1155de admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:59.541647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1342/2660] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:02:59 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:02:59.543946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6be72b-198a-4131-8bed-a25b79587cc7 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:59.557345 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6be72b-198a-4131-8bed-a25b79587cc7 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:59.564954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346073-7c94-49ea-91b6-bebeaab5a7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:59.565704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346073-7c94-49ea-91b6-bebeaab5a7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.565994 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346073-7c94-49ea-91b6-bebeaab5a7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.566275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346073-7c94-49ea-91b6-bebeaab5a7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.567019 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4346073-7c94-49ea-91b6-bebeaab5a7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:59.568668 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4346073-7c94-49ea-91b6-bebeaab5a7c6 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:59.580051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1319/2661] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:59.584499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ef43e-2b1e-4cd8-b222-98459f1155de admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:59.600520 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ef43e-2b1e-4cd8-b222-98459f1155de admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:59.607210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960593af-ec68-41e3-834c-59b53b99f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:59.608235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960593af-ec68-41e3-834c-59b53b99f035 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.608527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960593af-ec68-41e3-834c-59b53b99f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.608780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960593af-ec68-41e3-834c-59b53b99f035 admin admin] PATH_INFO: `/v3/projects/22751e104f6444dc8733341b1cfc25b0/users/d4aee66eaa284ace8599b1c9ad666516/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.628486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960593af-ec68-41e3-834c-59b53b99f035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22751e104f6444dc8733341b1cfc25b0, user_id=d4aee66eaa284ace8599b1c9ad666516, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:59.631251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960593af-ec68-41e3-834c-59b53b99f035 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:59.649188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1343/2662] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:59 2022] PUT /identity/v3/projects/22751e104f6444dc8733341b1cfc25b0/users/d4aee66eaa284ace8599b1c9ad666516/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:59.653304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346073-7c94-49ea-91b6-bebeaab5a7c6 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:59.664328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346073-7c94-49ea-91b6-bebeaab5a7c6 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:59.736858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420ce75-a1ba-4a97-a67c-0bc1e3cbe703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:59.738056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420ce75-a1ba-4a97-a67c-0bc1e3cbe703 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.738567 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420ce75-a1ba-4a97-a67c-0bc1e3cbe703 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.739070 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420ce75-a1ba-4a97-a67c-0bc1e3cbe703 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.740827 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420ce75-a1ba-4a97-a67c-0bc1e3cbe703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:59.744318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420ce75-a1ba-4a97-a67c-0bc1e3cbe703 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:59.764739 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1320/2663] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:02:59.769516 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960593af-ec68-41e3-834c-59b53b99f035 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:59.782473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960593af-ec68-41e3-834c-59b53b99f035 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:02:59.792586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251260-2f51-441e-82e4-24d9b69cc46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:02:59.794453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251260-2f51-441e-82e4-24d9b69cc46f admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.794749 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251260-2f51-441e-82e4-24d9b69cc46f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.795022 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251260-2f51-441e-82e4-24d9b69cc46f admin admin] PATH_INFO: `/v3/projects/22751e104f6444dc8733341b1cfc25b0/users/d4aee66eaa284ace8599b1c9ad666516/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.797642 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae251260-2f51-441e-82e4-24d9b69cc46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22751e104f6444dc8733341b1cfc25b0, user_id=d4aee66eaa284ace8599b1c9ad666516, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:02:59.800348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae251260-2f51-441e-82e4-24d9b69cc46f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:02:59.813128 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1344/2664] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:02:59 2022] PUT /identity/v3/projects/22751e104f6444dc8733341b1cfc25b0/users/d4aee66eaa284ace8599b1c9ad666516/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:02:59.824115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e032f84-afd4-4939-93fa-a60b342c8563 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:02:59.825028 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e032f84-afd4-4939-93fa-a60b342c8563 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:02:59.825371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e032f84-afd4-4939-93fa-a60b342c8563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:02:59.856229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-3e032f84-afd4-4939-93fa-a60b342c8563 None None] MFA Rules not processed for user `d4aee66eaa284ace8599b1c9ad666516`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:02:59.857880 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3e032f84-afd4-4939-93fa-a60b342c8563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:02:59.979079 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1321/2665] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:02:59 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:02:59.998033 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251260-2f51-441e-82e4-24d9b69cc46f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:02:59.999829 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-ae251260-2f51-441e-82e4-24d9b69cc46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:00.084753 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251260-2f51-441e-82e4-24d9b69cc46f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:00.089078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac5754-bba8-4d49-bafe-3f769f9ac21d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:00.089765 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac5754-bba8-4d49-bafe-3f769f9ac21d service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:00.090046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac5754-bba8-4d49-bafe-3f769f9ac21d service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:00.090350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac5754-bba8-4d49-bafe-3f769f9ac21d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:00.102441 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac5754-bba8-4d49-bafe-3f769f9ac21d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:00.104031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac5754-bba8-4d49-bafe-3f769f9ac21d service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:00.115454 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1345/2666] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:02:59 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:03:00.212649 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e032f84-afd4-4939-93fa-a60b342c8563 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:00.214188 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-3e032f84-afd4-4939-93fa-a60b342c8563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:00.229466 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e032f84-afd4-4939-93fa-a60b342c8563 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:00.237025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ce8f8-b308-4a3e-9d93-a4e6449ad8ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:00.238288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ce8f8-b308-4a3e-9d93-a4e6449ad8ec service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:00.238809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ce8f8-b308-4a3e-9d93-a4e6449ad8ec service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:00.239310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ce8f8-b308-4a3e-9d93-a4e6449ad8ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:00.314526 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ce8f8-b308-4a3e-9d93-a4e6449ad8ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:00.316289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ce8f8-b308-4a3e-9d93-a4e6449ad8ec service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:00.327333 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1322/2667] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:03:01.175343 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac5754-bba8-4d49-bafe-3f769f9ac21d service cinder] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:01.177134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1aac5754-bba8-4d49-bafe-3f769f9ac21d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:01.284924 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac5754-bba8-4d49-bafe-3f769f9ac21d service cinder] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:01.291605 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933de48-da62-47d5-b06a-d2e905224a1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221dab3ebc4f4c68b253729391e9c503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:01.293410 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933de48-da62-47d5-b06a-d2e905224a1a service placement] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:01.293839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933de48-da62-47d5-b06a-d2e905224a1a service placement] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:01.294082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933de48-da62-47d5-b06a-d2e905224a1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:01.297489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-7933de48-da62-47d5-b06a-d2e905224a1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:01.318966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933de48-da62-47d5-b06a-d2e905224a1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:01.321205 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933de48-da62-47d5-b06a-d2e905224a1a service placement] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:01.334606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1346/2668] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:03:02.598257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ce8f8-b308-4a3e-9d93-a4e6449ad8ec service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:02.599714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-322ce8f8-b308-4a3e-9d93-a4e6449ad8ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:02.706652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ce8f8-b308-4a3e-9d93-a4e6449ad8ec service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:02.712277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:02.713747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:02.714232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:02.714721 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] PATH_INFO: `/v3/users/ded8b3214eb047d4a1f580c4453a1f42` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:02.716822 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded8b3214eb047d4a1f580c4453a1f42)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:02.720698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:02.801947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded8b3214eb047d4a1f580c4453a1f42'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:02.802636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded8b3214eb047d4a1f580c4453a1f42'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:02.803292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded8b3214eb047d4a1f580c4453a1f42'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:02.815004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded8b3214eb047d4a1f580c4453a1f42'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:02.842312 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded8b3214eb047d4a1f580c4453a1f42'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:02.861156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1323/2669] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:02 2022] DELETE /identity/v3/users/ded8b3214eb047d4a1f580c4453a1f42 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:03.048201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933de48-da62-47d5-b06a-d2e905224a1a service placement] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:03.061723 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933de48-da62-47d5-b06a-d2e905224a1a service placement] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:03.140743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:03.141656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:03.141944 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:03.142215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] PATH_INFO: `/v3/projects/876780e50b1845259edd80270e3cb845` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:03.143408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=876780e50b1845259edd80270e3cb845)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:03.145320 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:03.206883 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876780e50b1845259edd80270e3cb845', 'request_id': 'req-e832f961-8ecf-49b9-9823-4cfc8e209b8a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.216915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876780e50b1845259edd80270e3cb845', 'request_id': 'req-e832f961-8ecf-49b9-9823-4cfc8e209b8a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.225466 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876780e50b1845259edd80270e3cb845', 'request_id': 'req-e832f961-8ecf-49b9-9823-4cfc8e209b8a'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.238211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] The token cache is being invalidate because project 876780e50b1845259edd80270e3cb845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:03.238570 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.239164 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.242494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1347/2670] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:03 2022] DELETE /identity/v3/projects/876780e50b1845259edd80270e3cb845 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:03.250341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:03.250341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:03.263221 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a0cba-8333-4b71-a491-6a5f29c1d7a3 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:03.295742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:03.297824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:03.339100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:03.340107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:03.340490 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:03.340983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] PATH_INFO: `/v3/users/78754dd72c484170b410f352771484e0` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:03.342692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78754dd72c484170b410f352771484e0)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:03.345655 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:03.380678 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832f961-8ecf-49b9-9823-4cfc8e209b8a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:03.385659 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:03.386538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:03.386913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:03.387109 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] PATH_INFO: `/v3/users/0b069043ec334a1c8492bfb2af90baae` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:03.388336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b069043ec334a1c8492bfb2af90baae)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:03.390300 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:03.407673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78754dd72c484170b410f352771484e0'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.408638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78754dd72c484170b410f352771484e0'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.409506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78754dd72c484170b410f352771484e0'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.419742 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78754dd72c484170b410f352771484e0'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.438003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-090f6f20-3dca-4798-940d-0262384ee8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78754dd72c484170b410f352771484e0'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.453413 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1324/2671] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:03 2022] DELETE /identity/v3/users/78754dd72c484170b410f352771484e0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:03.463601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b069043ec334a1c8492bfb2af90baae'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.464577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b069043ec334a1c8492bfb2af90baae'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.465384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b069043ec334a1c8492bfb2af90baae'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.482902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b069043ec334a1c8492bfb2af90baae'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.493527 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b069043ec334a1c8492bfb2af90baae'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.517069 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1348/2672] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:03 2022] DELETE /identity/v3/users/0b069043ec334a1c8492bfb2af90baae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:03:03.521611 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec3841-b1ac-4d77-a431-bc6ff32c7227 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:03.522262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec3841-b1ac-4d77-a431-bc6ff32c7227 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:03.522262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec3841-b1ac-4d77-a431-bc6ff32c7227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:03.543156 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-eaec3841-b1ac-4d77-a431-bc6ff32c7227 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:03.544430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-eaec3841-b1ac-4d77-a431-bc6ff32c7227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:03.613453 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1325/2673] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:03.623957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:03.625478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:03.705421 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7a587-9e10-44f2-9552-cbfd94f693a5 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:03.712506 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec3841-b1ac-4d77-a431-bc6ff32c7227 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:03.714394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaeb72-b832-4bfb-a74f-c1b5b874f0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:03.714814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-eaec3841-b1ac-4d77-a431-bc6ff32c7227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:03.715602 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaeb72-b832-4bfb-a74f-c1b5b874f0db service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:03.716255 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaeb72-b832-4bfb-a74f-c1b5b874f0db service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:03.716755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaeb72-b832-4bfb-a74f-c1b5b874f0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:03.738882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec3841-b1ac-4d77-a431-bc6ff32c7227 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:03.740329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaeb72-b832-4bfb-a74f-c1b5b874f0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:03.742643 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaeb72-b832-4bfb-a74f-c1b5b874f0db service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:03.748011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:03.749260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:03.749684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:03.750147 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] PATH_INFO: `/v3/projects/2ac1ca9b7c1c4652b1bf47d2b0a11092` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:03.752260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac1ca9b7c1c4652b1bf47d2b0a11092)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:03.755055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1349/2674] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:03:03.755264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:03.845235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac1ca9b7c1c4652b1bf47d2b0a11092', 'request_id': 'req-1bb36edf-74e3-4636-a569-7a2614118859'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.856433 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac1ca9b7c1c4652b1bf47d2b0a11092', 'request_id': 'req-1bb36edf-74e3-4636-a569-7a2614118859'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.871750 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac1ca9b7c1c4652b1bf47d2b0a11092', 'request_id': 'req-1bb36edf-74e3-4636-a569-7a2614118859'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.896754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] The token cache is being invalidate because project 2ac1ca9b7c1c4652b1bf47d2b0a11092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:03.897262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.898428 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:03.912668 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1326/2675] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:03 2022] DELETE /identity/v3/projects/2ac1ca9b7c1c4652b1bf47d2b0a11092 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:04.182732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaeb72-b832-4bfb-a74f-c1b5b874f0db service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:04.185968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9deaeb72-b832-4bfb-a74f-c1b5b874f0db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:04.208818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaeb72-b832-4bfb-a74f-c1b5b874f0db service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:04.290447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:04.291328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:04.291617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:04.291895 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] PATH_INFO: `/v3/projects/97426c253f39443cbe2e917e990fa897` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:04.293103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97426c253f39443cbe2e917e990fa897)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:04.295060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:04.361692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97426c253f39443cbe2e917e990fa897', 'request_id': 'req-4dfd7a59-f405-4537-9c28-0d13ceae93e9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:04.372755 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97426c253f39443cbe2e917e990fa897', 'request_id': 'req-4dfd7a59-f405-4537-9c28-0d13ceae93e9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:04.384879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97426c253f39443cbe2e917e990fa897', 'request_id': 'req-4dfd7a59-f405-4537-9c28-0d13ceae93e9'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:04.400111 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] The token cache is being invalidate because project 97426c253f39443cbe2e917e990fa897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:04.400774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:04.401725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:04.403671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1350/2676] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:04 2022] DELETE /identity/v3/projects/97426c253f39443cbe2e917e990fa897 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:04.407761 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:04.409423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:04.422725 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb36edf-74e3-4636-a569-7a2614118859 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:04.483765 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:04.484660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:04.484948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:04.485234 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] PATH_INFO: `/v3/users/d4aee66eaa284ace8599b1c9ad666516` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:04.486686 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4aee66eaa284ace8599b1c9ad666516)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:04.488701 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:04.545361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4aee66eaa284ace8599b1c9ad666516'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:04.546055 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4aee66eaa284ace8599b1c9ad666516'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:04.546653 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4aee66eaa284ace8599b1c9ad666516'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:04.555360 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4aee66eaa284ace8599b1c9ad666516'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:04.579117 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-f3a6cde6-b316-4066-accd-28a8617aa935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4aee66eaa284ace8599b1c9ad666516'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:04.595050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1327/2677] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:04 2022] DELETE /identity/v3/users/d4aee66eaa284ace8599b1c9ad666516 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:03:04.968331 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:04.969514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:04.995708 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd7a59-f405-4537-9c28-0d13ceae93e9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:05.071968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:05.073500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.074061 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.074571 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] PATH_INFO: `/v3/projects/22751e104f6444dc8733341b1cfc25b0` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.076600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] RBAC: Authorizing `identity:delete_project(project_id=22751e104f6444dc8733341b1cfc25b0)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:05.079107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:05.128368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22751e104f6444dc8733341b1cfc25b0', 'request_id': 'req-e7c0dc6c-2165-43db-a444-1790f0c3726f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:05.135219 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22751e104f6444dc8733341b1cfc25b0', 'request_id': 'req-e7c0dc6c-2165-43db-a444-1790f0c3726f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:05.147512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22751e104f6444dc8733341b1cfc25b0', 'request_id': 'req-e7c0dc6c-2165-43db-a444-1790f0c3726f'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:05.160763 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] The token cache is being invalidate because project 22751e104f6444dc8733341b1cfc25b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:05.161049 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:05.161742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e7c0dc6c-2165-43db-a444-1790f0c3726f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:05.163279 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1351/2678] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:04 2022] DELETE /identity/v3/projects/22751e104f6444dc8733341b1cfc25b0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:05.168738 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3791166-dc2f-4e57-bb42-dcb93392f48e None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.169384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3791166-dc2f-4e57-bb42-dcb93392f48e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.169384 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3791166-dc2f-4e57-bb42-dcb93392f48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.187939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d3791166-dc2f-4e57-bb42-dcb93392f48e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:05.189184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d3791166-dc2f-4e57-bb42-dcb93392f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:05.261473 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1328/2679] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:05.270453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7a9d6-5556-4b7d-8724-e9afb36815ca None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.270991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7a9d6-5556-4b7d-8724-e9afb36815ca None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.270991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7a9d6-5556-4b7d-8724-e9afb36815ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.291315 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-eac7a9d6-5556-4b7d-8724-e9afb36815ca None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:05.292514 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-eac7a9d6-5556-4b7d-8724-e9afb36815ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:05.301213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1352/2680] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:05.306210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3791166-dc2f-4e57-bb42-dcb93392f48e None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:05.315900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3791166-dc2f-4e57-bb42-dcb93392f48e None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:05.320454 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326a09b-2c2f-411b-9631-709316e7620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:05.321107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326a09b-2c2f-411b-9631-709316e7620d admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.321387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326a09b-2c2f-411b-9631-709316e7620d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.321698 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326a09b-2c2f-411b-9631-709316e7620d admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.322440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326a09b-2c2f-411b-9631-709316e7620d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:03:05.322742 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326a09b-2c2f-411b-9631-709316e7620d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:05.324403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326a09b-2c2f-411b-9631-709316e7620d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:05.337898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1329/2681] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:03:05.345026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7a9d6-5556-4b7d-8724-e9afb36815ca None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:05.363568 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7a9d6-5556-4b7d-8724-e9afb36815ca None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:05.371715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f0a2e-8cd1-4075-a558-1db8c9e4fce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:05.372886 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0a2e-8cd1-4075-a558-1db8c9e4fce6 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.373416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0a2e-8cd1-4075-a558-1db8c9e4fce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.373975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f0a2e-8cd1-4075-a558-1db8c9e4fce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.375345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f0a2e-8cd1-4075-a558-1db8c9e4fce6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:05.379326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f0a2e-8cd1-4075-a558-1db8c9e4fce6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:05.420695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1353/2682] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:03:05 2022] POST /identity/v3/projects => generated 393 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:05.426823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326a09b-2c2f-411b-9631-709316e7620d admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:05.437688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326a09b-2c2f-411b-9631-709316e7620d admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:05.496885 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25775f09-901c-48f6-b28d-63d847a72e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:05.497557 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775f09-901c-48f6-b28d-63d847a72e93 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.497873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775f09-901c-48f6-b28d-63d847a72e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.498149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775f09-901c-48f6-b28d-63d847a72e93 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.498850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25775f09-901c-48f6-b28d-63d847a72e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:05.500796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25775f09-901c-48f6-b28d-63d847a72e93 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:05.522711 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1330/2683] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:03:05 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:05.527537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f0a2e-8cd1-4075-a558-1db8c9e4fce6 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:05.542132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f0a2e-8cd1-4075-a558-1db8c9e4fce6 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:05.546946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d1be9-8c8d-4f8b-8068-a348cec17bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:05.547644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d1be9-8c8d-4f8b-8068-a348cec17bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.547931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d1be9-8c8d-4f8b-8068-a348cec17bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.548211 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d1be9-8c8d-4f8b-8068-a348cec17bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.548988 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d1be9-8c8d-4f8b-8068-a348cec17bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:05.550640 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d1be9-8c8d-4f8b-8068-a348cec17bc2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:05.563190 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1354/2684] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:05.569177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25775f09-901c-48f6-b28d-63d847a72e93 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:05.580220 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25775f09-901c-48f6-b28d-63d847a72e93 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:05.584922 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37025b-f5e9-4dd1-9ee4-077185fe9ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:05.585801 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37025b-f5e9-4dd1-9ee4-077185fe9ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.586187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37025b-f5e9-4dd1-9ee4-077185fe9ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.586673 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37025b-f5e9-4dd1-9ee4-077185fe9ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.587407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37025b-f5e9-4dd1-9ee4-077185fe9ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:05.589031 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37025b-f5e9-4dd1-9ee4-077185fe9ce1 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:05.616430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1331/2685] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:05.618339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d1be9-8c8d-4f8b-8068-a348cec17bc2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:05.630996 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d1be9-8c8d-4f8b-8068-a348cec17bc2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:05.637218 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d5ca-67bb-490d-9c72-4b74d6cfea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:05.638846 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d5ca-67bb-490d-9c72-4b74d6cfea7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.639340 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d5ca-67bb-490d-9c72-4b74d6cfea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.639835 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d5ca-67bb-490d-9c72-4b74d6cfea7d admin admin] PATH_INFO: `/v3/projects/de117f7a0ebd497483de0e5bf261a9ce/users/9894e1891fd1409f8058408f7236fceb/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.666662 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723d5ca-67bb-490d-9c72-4b74d6cfea7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de117f7a0ebd497483de0e5bf261a9ce, user_id=9894e1891fd1409f8058408f7236fceb, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:05.672339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723d5ca-67bb-490d-9c72-4b74d6cfea7d admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:05.693222 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1355/2686] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:03:05 2022] PUT /identity/v3/projects/de117f7a0ebd497483de0e5bf261a9ce/users/9894e1891fd1409f8058408f7236fceb/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:05.706743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0e5f0-041b-4ed9-8111-1866f97a091e None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.707036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0e5f0-041b-4ed9-8111-1866f97a091e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.707317 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0e5f0-041b-4ed9-8111-1866f97a091e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.738708 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-85e0e5f0-041b-4ed9-8111-1866f97a091e None None] MFA Rules not processed for user `9894e1891fd1409f8058408f7236fceb`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:05.739944 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-85e0e5f0-041b-4ed9-8111-1866f97a091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:05.808330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1332/2687] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:05.813021 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d5ca-67bb-490d-9c72-4b74d6cfea7d admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:05.876672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d5ca-67bb-490d-9c72-4b74d6cfea7d admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:05.882292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c730d90-4248-4727-850b-027aac573fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:05.884227 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730d90-4248-4727-850b-027aac573fbe admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:05.884519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730d90-4248-4727-850b-027aac573fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:05.884803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c730d90-4248-4727-850b-027aac573fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:05.885519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c730d90-4248-4727-850b-027aac573fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:05.887470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c730d90-4248-4727-850b-027aac573fbe admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:05.926290 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1356/2688] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:03:05 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 13:03:05.930894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0e5f0-041b-4ed9-8111-1866f97a091e None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:05.942285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0e5f0-041b-4ed9-8111-1866f97a091e None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:06.008605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de57cee-ea8b-4d69-85c3-6d5ad5dd8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:06.009469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de57cee-ea8b-4d69-85c3-6d5ad5dd8e67 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:06.009866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de57cee-ea8b-4d69-85c3-6d5ad5dd8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:06.010050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de57cee-ea8b-4d69-85c3-6d5ad5dd8e67 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:06.010758 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de57cee-ea8b-4d69-85c3-6d5ad5dd8e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:06.012710 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de57cee-ea8b-4d69-85c3-6d5ad5dd8e67 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:06.035295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1333/2689] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:03:05 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:06.039796 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c730d90-4248-4727-850b-027aac573fbe admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:06.055490 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c730d90-4248-4727-850b-027aac573fbe admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:06.062099 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bcacd-4163-4f4e-a0e0-7083277eb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:06.063058 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bcacd-4163-4f4e-a0e0-7083277eb66a admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:06.063568 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bcacd-4163-4f4e-a0e0-7083277eb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:06.064074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9bcacd-4163-4f4e-a0e0-7083277eb66a admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:06.065491 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9bcacd-4163-4f4e-a0e0-7083277eb66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:06.068694 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9bcacd-4163-4f4e-a0e0-7083277eb66a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:06.084308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1357/2690] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 13:03:06.088959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de57cee-ea8b-4d69-85c3-6d5ad5dd8e67 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:06.098888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de57cee-ea8b-4d69-85c3-6d5ad5dd8e67 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:06.103979 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ddc34-b3c3-42d2-a140-af02991bad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:06.104879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ddc34-b3c3-42d2-a140-af02991bad5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:06.105161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ddc34-b3c3-42d2-a140-af02991bad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:06.105437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ddc34-b3c3-42d2-a140-af02991bad5b admin admin] PATH_INFO: `/v3/projects/7c01bd7219044108addb5388f3ca8c0e/users/7f7e2202e9e1482a9d8343a4398962d8/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:06.123414 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ddc34-b3c3-42d2-a140-af02991bad5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c01bd7219044108addb5388f3ca8c0e, user_id=7f7e2202e9e1482a9d8343a4398962d8, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:06.126215 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ddc34-b3c3-42d2-a140-af02991bad5b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:06.142155 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1334/2691] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:03:06 2022] PUT /identity/v3/projects/7c01bd7219044108addb5388f3ca8c0e/users/7f7e2202e9e1482a9d8343a4398962d8/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:03:06.149541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bcacd-4163-4f4e-a0e0-7083277eb66a admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:06.166052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9bcacd-4163-4f4e-a0e0-7083277eb66a admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:06.233608 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8f028-f3f6-4bb8-9f02-7e4ef5920712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:06.234310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8f028-f3f6-4bb8-9f02-7e4ef5920712 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:06.234589 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8f028-f3f6-4bb8-9f02-7e4ef5920712 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:06.234871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8f028-f3f6-4bb8-9f02-7e4ef5920712 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:06.235616 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8f028-f3f6-4bb8-9f02-7e4ef5920712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:06.237254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8f028-f3f6-4bb8-9f02-7e4ef5920712 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:06.249333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1358/2692] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:06.254134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ddc34-b3c3-42d2-a140-af02991bad5b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:06.266394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ddc34-b3c3-42d2-a140-af02991bad5b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:06.271062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed978-3798-48e7-b1e7-1fc226c96e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:06.271927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed978-3798-48e7-b1e7-1fc226c96e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:06.272206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed978-3798-48e7-b1e7-1fc226c96e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:06.272477 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ed978-3798-48e7-b1e7-1fc226c96e22 admin admin] PATH_INFO: `/v3/projects/7c01bd7219044108addb5388f3ca8c0e/users/7f7e2202e9e1482a9d8343a4398962d8/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:06.274707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ed978-3798-48e7-b1e7-1fc226c96e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c01bd7219044108addb5388f3ca8c0e, user_id=7f7e2202e9e1482a9d8343a4398962d8, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:06.277418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ed978-3798-48e7-b1e7-1fc226c96e22 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:06.289404 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1335/2693] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:03:06 2022] PUT /identity/v3/projects/7c01bd7219044108addb5388f3ca8c0e/users/7f7e2202e9e1482a9d8343a4398962d8/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:06.300103 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1326c8-9dd3-46b1-9aa2-8b18bae315f4 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:06.300672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1326c8-9dd3-46b1-9aa2-8b18bae315f4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:06.300672 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1326c8-9dd3-46b1-9aa2-8b18bae315f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:06.335987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-fb1326c8-9dd3-46b1-9aa2-8b18bae315f4 None None] MFA Rules not processed for user `7f7e2202e9e1482a9d8343a4398962d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:06.338057 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-fb1326c8-9dd3-46b1-9aa2-8b18bae315f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:06.411638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1359/2694] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:06.426786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed978-3798-48e7-b1e7-1fc226c96e22 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:06.428576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-505ed978-3798-48e7-b1e7-1fc226c96e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:06.526960 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ed978-3798-48e7-b1e7-1fc226c96e22 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:06.533142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a83f9-d801-4050-8e42-a3b31e6763ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:06.534353 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a83f9-d801-4050-8e42-a3b31e6763ef service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:06.534887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a83f9-d801-4050-8e42-a3b31e6763ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:06.535408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a83f9-d801-4050-8e42-a3b31e6763ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:06.554052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a83f9-d801-4050-8e42-a3b31e6763ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:06.557674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a83f9-d801-4050-8e42-a3b31e6763ef service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:06.576398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1336/2695] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:03:06.621314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1326c8-9dd3-46b1-9aa2-8b18bae315f4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:06.623159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-fb1326c8-9dd3-46b1-9aa2-8b18bae315f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:06.637967 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1326c8-9dd3-46b1-9aa2-8b18bae315f4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:06.641603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ab093-f33d-4713-bfa0-13e2b722bde7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:06.642251 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ab093-f33d-4713-bfa0-13e2b722bde7 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:06.642533 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ab093-f33d-4713-bfa0-13e2b722bde7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:06.642809 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ab093-f33d-4713-bfa0-13e2b722bde7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:06.715215 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ab093-f33d-4713-bfa0-13e2b722bde7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:06.716741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ab093-f33d-4713-bfa0-13e2b722bde7 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:06.733228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1360/2696] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:03:10.160986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a83f9-d801-4050-8e42-a3b31e6763ef service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:10.246022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a83f9-d801-4050-8e42-a3b31e6763ef service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:10.253772 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:10.255329 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:10.255795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:10.256199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] PATH_INFO: `/v3/users/9894e1891fd1409f8058408f7236fceb` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:10.259017 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9894e1891fd1409f8058408f7236fceb)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:10.262264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:10.319531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9894e1891fd1409f8058408f7236fceb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:10.321051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9894e1891fd1409f8058408f7236fceb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:10.321664 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9894e1891fd1409f8058408f7236fceb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:10.332532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9894e1891fd1409f8058408f7236fceb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:10.345755 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9894e1891fd1409f8058408f7236fceb'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:10.361489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1337/2697] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:10 2022] DELETE /identity/v3/users/9894e1891fd1409f8058408f7236fceb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:10.367409 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5cd0-5f22-4a69-ba15-b5e86c5084d4 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:10.368328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5cd0-5f22-4a69-ba15-b5e86c5084d4 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:10.368328 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5cd0-5f22-4a69-ba15-b5e86c5084d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:10.387134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-1cdd5cd0-5f22-4a69-ba15-b5e86c5084d4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:10.388335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1cdd5cd0-5f22-4a69-ba15-b5e86c5084d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:10.495798 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1361/2698] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:03:10.509169 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:10.510716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:10.570909 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b731d5-0e3a-4cf5-9485-1e802eecbb7b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:10.574652 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f452-9a7b-45ad-8ecd-6a7ce1c34d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:10.575299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f452-9a7b-45ad-8ecd-6a7ce1c34d55 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:10.575616 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f452-9a7b-45ad-8ecd-6a7ce1c34d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:10.575848 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3f452-9a7b-45ad-8ecd-6a7ce1c34d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:10.585429 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3f452-9a7b-45ad-8ecd-6a7ce1c34d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:10.586977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3f452-9a7b-45ad-8ecd-6a7ce1c34d55 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:10.596502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1338/2699] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:03:10.886099 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd5cd0-5f22-4a69-ba15-b5e86c5084d4 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:10.887727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1cdd5cd0-5f22-4a69-ba15-b5e86c5084d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:10.901100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd5cd0-5f22-4a69-ba15-b5e86c5084d4 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:10.907820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:10.908699 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:10.909075 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:10.909247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] PATH_INFO: `/v3/projects/de117f7a0ebd497483de0e5bf261a9ce` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:10.910579 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de117f7a0ebd497483de0e5bf261a9ce)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:10.912521 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:10.968318 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de117f7a0ebd497483de0e5bf261a9ce', 'request_id': 'req-2f979860-6798-4c28-9ff6-aa5f483aaaf1'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:10.975444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de117f7a0ebd497483de0e5bf261a9ce', 'request_id': 'req-2f979860-6798-4c28-9ff6-aa5f483aaaf1'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:10.984368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de117f7a0ebd497483de0e5bf261a9ce', 'request_id': 'req-2f979860-6798-4c28-9ff6-aa5f483aaaf1'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:10.995397 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] The token cache is being invalidate because project de117f7a0ebd497483de0e5bf261a9ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:10.995685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:10.996432 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:10.998071 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1362/2700] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:10 2022] DELETE /identity/v3/projects/de117f7a0ebd497483de0e5bf261a9ce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:11.002393 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f452-9a7b-45ad-8ecd-6a7ce1c34d55 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:11.012765 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3f452-9a7b-45ad-8ecd-6a7ce1c34d55 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:11.094343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:11.095228 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:11.095513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:11.095785 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] PATH_INFO: `/v3/users/7f7e2202e9e1482a9d8343a4398962d8` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:11.096982 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7e2202e9e1482a9d8343a4398962d8)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:11.098974 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:11.151013 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7e2202e9e1482a9d8343a4398962d8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:11.151677 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7e2202e9e1482a9d8343a4398962d8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:11.152287 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7e2202e9e1482a9d8343a4398962d8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:11.159429 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7e2202e9e1482a9d8343a4398962d8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:11.173639 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-0fcfd079-571b-44f4-ae34-38953b4e67ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7e2202e9e1482a9d8343a4398962d8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:11.188100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1339/2701] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:11 2022] DELETE /identity/v3/users/7f7e2202e9e1482a9d8343a4398962d8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:03:11.468638 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:11.470231 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:11.489905 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f979860-6798-4c28-9ff6-aa5f483aaaf1 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:11.550345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:11.551337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:11.551760 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:11.552040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] PATH_INFO: `/v3/projects/7c01bd7219044108addb5388f3ca8c0e` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:11.553973 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c01bd7219044108addb5388f3ca8c0e)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:11.558405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:11.622232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c01bd7219044108addb5388f3ca8c0e', 'request_id': 'req-2ca88972-ea49-4dec-9d24-48af7634f6e5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:11.628465 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c01bd7219044108addb5388f3ca8c0e', 'request_id': 'req-2ca88972-ea49-4dec-9d24-48af7634f6e5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:11.637644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c01bd7219044108addb5388f3ca8c0e', 'request_id': 'req-2ca88972-ea49-4dec-9d24-48af7634f6e5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:11.649681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] The token cache is being invalidate because project 7c01bd7219044108addb5388f3ca8c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:11.649976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:11.650590 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2ca88972-ea49-4dec-9d24-48af7634f6e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:11.652169 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1363/2702] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:11 2022] DELETE /identity/v3/projects/7c01bd7219044108addb5388f3ca8c0e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:11.657161 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7d0a9-ab27-4816-b19c-ada7115f04f3 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:11.657449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7d0a9-ab27-4816-b19c-ada7115f04f3 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:11.657764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7d0a9-ab27-4816-b19c-ada7115f04f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:11.686380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-29b7d0a9-ab27-4816-b19c-ada7115f04f3 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:11.688431 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-29b7d0a9-ab27-4816-b19c-ada7115f04f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:11.770268 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1340/2703] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:11.779941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150801de-e389-4beb-87ea-e62135561b66 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:11.780223 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150801de-e389-4beb-87ea-e62135561b66 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:11.780500 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150801de-e389-4beb-87ea-e62135561b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:11.799045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-150801de-e389-4beb-87ea-e62135561b66 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:11.800290 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-150801de-e389-4beb-87ea-e62135561b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:11.814841 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1364/2704] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:11.818903 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7d0a9-ab27-4816-b19c-ada7115f04f3 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:11.829249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7d0a9-ab27-4816-b19c-ada7115f04f3 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:11.834100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a2a6a-a56b-406d-bae1-35ff28255e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:11.834762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a2a6a-a56b-406d-bae1-35ff28255e8d admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:11.835043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a2a6a-a56b-406d-bae1-35ff28255e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:11.835307 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a2a6a-a56b-406d-bae1-35ff28255e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:11.836714 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a2a6a-a56b-406d-bae1-35ff28255e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:03:11.836991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a2a6a-a56b-406d-bae1-35ff28255e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:11.838660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a2a6a-a56b-406d-bae1-35ff28255e8d admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:11.850747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1341/2705] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 06 13:03:11.863440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150801de-e389-4beb-87ea-e62135561b66 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:11.876326 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150801de-e389-4beb-87ea-e62135561b66 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:11.881232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cbfa0-71d3-400a-8a21-3be2b8cd1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:11.881923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cbfa0-71d3-400a-8a21-3be2b8cd1ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:11.882237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cbfa0-71d3-400a-8a21-3be2b8cd1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:11.882570 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cbfa0-71d3-400a-8a21-3be2b8cd1ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:11.882570 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cbfa0-71d3-400a-8a21-3be2b8cd1ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:11.885165 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cbfa0-71d3-400a-8a21-3be2b8cd1ac1 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:11.915094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1365/2706] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:03:11 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:11.922461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a2a6a-a56b-406d-bae1-35ff28255e8d admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:11.936448 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a2a6a-a56b-406d-bae1-35ff28255e8d admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:12.016737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f291ce-a1f8-4a37-847e-50c0050704d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:12.017951 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f291ce-a1f8-4a37-847e-50c0050704d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.018494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f291ce-a1f8-4a37-847e-50c0050704d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.019061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f291ce-a1f8-4a37-847e-50c0050704d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.020705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f291ce-a1f8-4a37-847e-50c0050704d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:12.024346 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f291ce-a1f8-4a37-847e-50c0050704d9 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:12.055730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1342/2707] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:03:11 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:12.059094 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cbfa0-71d3-400a-8a21-3be2b8cd1ac1 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:12.078356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cbfa0-71d3-400a-8a21-3be2b8cd1ac1 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:12.083117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee35780-fed1-49ba-9adc-36700644783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:12.083795 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee35780-fed1-49ba-9adc-36700644783f admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.084082 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee35780-fed1-49ba-9adc-36700644783f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.084364 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee35780-fed1-49ba-9adc-36700644783f admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.085122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee35780-fed1-49ba-9adc-36700644783f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:12.087613 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee35780-fed1-49ba-9adc-36700644783f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:12.098579 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1366/2708] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:12.104071 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f291ce-a1f8-4a37-847e-50c0050704d9 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:12.114510 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f291ce-a1f8-4a37-847e-50c0050704d9 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:12.119560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f879c3-0ab0-4d55-a8d9-b47bbef7bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:12.120233 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f879c3-0ab0-4d55-a8d9-b47bbef7bfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.120518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f879c3-0ab0-4d55-a8d9-b47bbef7bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.120792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f879c3-0ab0-4d55-a8d9-b47bbef7bfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.121525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f879c3-0ab0-4d55-a8d9-b47bbef7bfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:12.123172 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f879c3-0ab0-4d55-a8d9-b47bbef7bfa4 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:12.133411 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1343/2709] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:12.137882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee35780-fed1-49ba-9adc-36700644783f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:12.148522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee35780-fed1-49ba-9adc-36700644783f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:12.153319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a59de-e49a-4c4f-9cef-a4861201992c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:12.154238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a59de-e49a-4c4f-9cef-a4861201992c admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.154519 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a59de-e49a-4c4f-9cef-a4861201992c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.154788 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a59de-e49a-4c4f-9cef-a4861201992c admin admin] PATH_INFO: `/v3/projects/0a469a0262174d81a802f1fcb333fc89/users/ab50920a13c54d4e81570e9851a2dbf4/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.171884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a59de-e49a-4c4f-9cef-a4861201992c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a469a0262174d81a802f1fcb333fc89, user_id=ab50920a13c54d4e81570e9851a2dbf4, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:12.174717 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a59de-e49a-4c4f-9cef-a4861201992c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:12.188747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1367/2710] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:03:12 2022] PUT /identity/v3/projects/0a469a0262174d81a802f1fcb333fc89/users/ab50920a13c54d4e81570e9851a2dbf4/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:12.199371 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b18f36-81c0-4d1f-8b9f-5025ddf870f2 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.200020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b18f36-81c0-4d1f-8b9f-5025ddf870f2 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.200020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b18f36-81c0-4d1f-8b9f-5025ddf870f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.237249 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-72b18f36-81c0-4d1f-8b9f-5025ddf870f2 None None] MFA Rules not processed for user `ab50920a13c54d4e81570e9851a2dbf4`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:12.239297 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-72b18f36-81c0-4d1f-8b9f-5025ddf870f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:12.338685 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1344/2711] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:12.344018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a59de-e49a-4c4f-9cef-a4861201992c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:12.408861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a59de-e49a-4c4f-9cef-a4861201992c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:12.413936 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798da56b-f2b2-40a7-ae2d-c54100548eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:12.414606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798da56b-f2b2-40a7-ae2d-c54100548eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.414892 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798da56b-f2b2-40a7-ae2d-c54100548eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.415173 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798da56b-f2b2-40a7-ae2d-c54100548eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.415871 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798da56b-f2b2-40a7-ae2d-c54100548eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:12.417810 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798da56b-f2b2-40a7-ae2d-c54100548eb9 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:12.443172 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1368/2712] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:03:12 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:12.448394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b18f36-81c0-4d1f-8b9f-5025ddf870f2 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:12.459461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b18f36-81c0-4d1f-8b9f-5025ddf870f2 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:12.522064 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4acf64-0f6a-4da5-aa1a-7b23781c3713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:12.522795 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4acf64-0f6a-4da5-aa1a-7b23781c3713 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.524309 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4acf64-0f6a-4da5-aa1a-7b23781c3713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.524634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4acf64-0f6a-4da5-aa1a-7b23781c3713 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.525387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4acf64-0f6a-4da5-aa1a-7b23781c3713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:12.527456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4acf64-0f6a-4da5-aa1a-7b23781c3713 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:12.548858 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1345/2713] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:03:12 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:12.553664 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798da56b-f2b2-40a7-ae2d-c54100548eb9 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:12.566040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798da56b-f2b2-40a7-ae2d-c54100548eb9 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:12.574544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62660a6-db66-405e-b694-565400c9e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:12.575242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62660a6-db66-405e-b694-565400c9e215 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.575525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62660a6-db66-405e-b694-565400c9e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.575804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62660a6-db66-405e-b694-565400c9e215 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.576544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62660a6-db66-405e-b694-565400c9e215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:12.578200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62660a6-db66-405e-b694-565400c9e215 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:12.590390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1369/2714] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:12.596179 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4acf64-0f6a-4da5-aa1a-7b23781c3713 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:12.609458 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4acf64-0f6a-4da5-aa1a-7b23781c3713 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:12.617697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c28276-578e-4920-871b-4047be23d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:12.619292 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c28276-578e-4920-871b-4047be23d669 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.619818 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c28276-578e-4920-871b-4047be23d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.620347 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c28276-578e-4920-871b-4047be23d669 admin admin] PATH_INFO: `/v3/projects/6ea9a58042634f6f9839192f8ef676c4/users/5e7d072ed4aa411f9c275498a7356ad8/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.646997 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c28276-578e-4920-871b-4047be23d669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea9a58042634f6f9839192f8ef676c4, user_id=5e7d072ed4aa411f9c275498a7356ad8, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:12.650389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c28276-578e-4920-871b-4047be23d669 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:12.666245 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1346/2715] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:03:12 2022] PUT /identity/v3/projects/6ea9a58042634f6f9839192f8ef676c4/users/5e7d072ed4aa411f9c275498a7356ad8/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:12.670806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62660a6-db66-405e-b694-565400c9e215 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:12.682825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62660a6-db66-405e-b694-565400c9e215 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:12.740343 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba634d8-1323-4842-b572-42278a703828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:12.741023 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba634d8-1323-4842-b572-42278a703828 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.741310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba634d8-1323-4842-b572-42278a703828 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.742130 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba634d8-1323-4842-b572-42278a703828 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.743542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba634d8-1323-4842-b572-42278a703828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:12.745162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba634d8-1323-4842-b572-42278a703828 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:12.755759 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1370/2716] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:12.760706 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c28276-578e-4920-871b-4047be23d669 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:12.770991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c28276-578e-4920-871b-4047be23d669 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:12.775775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1ee9d-546b-4612-94b8-50b6c9c4658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:12.776610 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1ee9d-546b-4612-94b8-50b6c9c4658f admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.776886 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1ee9d-546b-4612-94b8-50b6c9c4658f admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.777189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1ee9d-546b-4612-94b8-50b6c9c4658f admin admin] PATH_INFO: `/v3/projects/6ea9a58042634f6f9839192f8ef676c4/users/5e7d072ed4aa411f9c275498a7356ad8/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.780217 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1ee9d-546b-4612-94b8-50b6c9c4658f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea9a58042634f6f9839192f8ef676c4, user_id=5e7d072ed4aa411f9c275498a7356ad8, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:12.783262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1ee9d-546b-4612-94b8-50b6c9c4658f admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:12.794791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1347/2717] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:03:12 2022] PUT /identity/v3/projects/6ea9a58042634f6f9839192f8ef676c4/users/5e7d072ed4aa411f9c275498a7356ad8/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:12.807116 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4146e9-37c7-4227-b3b9-21854869c812 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:12.807408 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4146e9-37c7-4227-b3b9-21854869c812 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:12.807693 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4146e9-37c7-4227-b3b9-21854869c812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:12.836715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-9d4146e9-37c7-4227-b3b9-21854869c812 None None] MFA Rules not processed for user `5e7d072ed4aa411f9c275498a7356ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:12.837990 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9d4146e9-37c7-4227-b3b9-21854869c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:12.910020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1371/2718] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:12.920936 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1ee9d-546b-4612-94b8-50b6c9c4658f admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:12.922733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4ae1ee9d-546b-4612-94b8-50b6c9c4658f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:12.997814 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1ee9d-546b-4612-94b8-50b6c9c4658f admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:13.001562 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84ca9c-32e0-4226-9cb4-472bce443255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:13.002237 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84ca9c-32e0-4226-9cb4-472bce443255 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:13.002522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84ca9c-32e0-4226-9cb4-472bce443255 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:13.002799 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84ca9c-32e0-4226-9cb4-472bce443255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:13.013735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84ca9c-32e0-4226-9cb4-472bce443255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:13.015225 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84ca9c-32e0-4226-9cb4-472bce443255 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:13.025224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1348/2719] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:03:13.613879 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4146e9-37c7-4227-b3b9-21854869c812 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:13.686895 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4146e9-37c7-4227-b3b9-21854869c812 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:13.691444 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:13.692310 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:13.692588 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:13.692861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] PATH_INFO: `/v3/users/ab50920a13c54d4e81570e9851a2dbf4` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:13.694235 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab50920a13c54d4e81570e9851a2dbf4)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:13.696543 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:13.744706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab50920a13c54d4e81570e9851a2dbf4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:13.745394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab50920a13c54d4e81570e9851a2dbf4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:13.746037 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab50920a13c54d4e81570e9851a2dbf4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:13.759625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab50920a13c54d4e81570e9851a2dbf4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:13.767945 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab50920a13c54d4e81570e9851a2dbf4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:13.781069 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1372/2720] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:13 2022] DELETE /identity/v3/users/ab50920a13c54d4e81570e9851a2dbf4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:13.785876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858d6c-335d-46a5-a645-e48a4db37a62 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:13.786437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858d6c-335d-46a5-a645-e48a4db37a62 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:13.786437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb858d6c-335d-46a5-a645-e48a4db37a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:13.805971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-bb858d6c-335d-46a5-a645-e48a4db37a62 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:13.807204 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bb858d6c-335d-46a5-a645-e48a4db37a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:13.869133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1349/2721] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:13.879228 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:13.880686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:13.938820 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4f453-b351-4c68-8219-38fc60da0802 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:13.943122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c4bbd-7ce3-4f12-9cf2-b51a63d28f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:13.943122 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c4bbd-7ce3-4f12-9cf2-b51a63d28f6c service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:13.943389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c4bbd-7ce3-4f12-9cf2-b51a63d28f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:13.943544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c4bbd-7ce3-4f12-9cf2-b51a63d28f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:13.954185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c4bbd-7ce3-4f12-9cf2-b51a63d28f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:13.955625 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c4bbd-7ce3-4f12-9cf2-b51a63d28f6c service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:13.966671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1373/2722] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:03:14.256418 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb858d6c-335d-46a5-a645-e48a4db37a62 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:14.258811 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bb858d6c-335d-46a5-a645-e48a4db37a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:14.270861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb858d6c-335d-46a5-a645-e48a4db37a62 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:14.276007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:14.276873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:14.277319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:14.277624 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] PATH_INFO: `/v3/projects/0a469a0262174d81a802f1fcb333fc89` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:14.278917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a469a0262174d81a802f1fcb333fc89)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:14.280784 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:14.331425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a469a0262174d81a802f1fcb333fc89', 'request_id': 'req-42a7944e-e545-4dd8-a8fa-f2692ac109ce'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.339270 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a469a0262174d81a802f1fcb333fc89', 'request_id': 'req-42a7944e-e545-4dd8-a8fa-f2692ac109ce'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.347665 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a469a0262174d81a802f1fcb333fc89', 'request_id': 'req-42a7944e-e545-4dd8-a8fa-f2692ac109ce'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.361096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] The token cache is being invalidate because project 0a469a0262174d81a802f1fcb333fc89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:14.361291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.361963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.363498 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1350/2723] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:14 2022] DELETE /identity/v3/projects/0a469a0262174d81a802f1fcb333fc89 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:14.368266 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c4bbd-7ce3-4f12-9cf2-b51a63d28f6c service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:14.378245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c4bbd-7ce3-4f12-9cf2-b51a63d28f6c service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:14.435011 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:14.436510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:14.436510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:14.436510 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] PATH_INFO: `/v3/users/5e7d072ed4aa411f9c275498a7356ad8` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:14.437493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7d072ed4aa411f9c275498a7356ad8)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:14.439446 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:14.487274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7d072ed4aa411f9c275498a7356ad8'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.487923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7d072ed4aa411f9c275498a7356ad8'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.488512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7d072ed4aa411f9c275498a7356ad8'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.501050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7d072ed4aa411f9c275498a7356ad8'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.511791 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-128c7da2-a447-4698-9869-f61e8187ee85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7d072ed4aa411f9c275498a7356ad8'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.526802 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1374/2724] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:14 2022] DELETE /identity/v3/users/5e7d072ed4aa411f9c275498a7356ad8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:14.808006 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:14.809539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:14.824649 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7944e-e545-4dd8-a8fa-f2692ac109ce admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:14.883622 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:14.884487 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:14.884788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:14.885059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] PATH_INFO: `/v3/projects/6ea9a58042634f6f9839192f8ef676c4` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:14.886242 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea9a58042634f6f9839192f8ef676c4)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:14.888167 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:14.940222 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea9a58042634f6f9839192f8ef676c4', 'request_id': 'req-70c48cad-2937-4abf-b1c3-6ac6df25da97'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.947746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea9a58042634f6f9839192f8ef676c4', 'request_id': 'req-70c48cad-2937-4abf-b1c3-6ac6df25da97'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.955574 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea9a58042634f6f9839192f8ef676c4', 'request_id': 'req-70c48cad-2937-4abf-b1c3-6ac6df25da97'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.967457 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] The token cache is being invalidate because project 6ea9a58042634f6f9839192f8ef676c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:14.967726 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.968369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-70c48cad-2937-4abf-b1c3-6ac6df25da97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:14.969953 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1351/2725] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:14 2022] DELETE /identity/v3/projects/6ea9a58042634f6f9839192f8ef676c4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:14.975808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1bfa0-8223-4e2c-bc38-473c2822824e None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:14.976440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1bfa0-8223-4e2c-bc38-473c2822824e None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:14.976440 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1bfa0-8223-4e2c-bc38-473c2822824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:14.993961 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-64f1bfa0-8223-4e2c-bc38-473c2822824e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:14.995152 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-64f1bfa0-8223-4e2c-bc38-473c2822824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:15.053308 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1375/2726] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:03:15.061740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d178-eeb5-457e-944e-15d89d5a3f54 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:15.062036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d178-eeb5-457e-944e-15d89d5a3f54 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:15.062320 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8d178-eeb5-457e-944e-15d89d5a3f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:15.080913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c3d8d178-eeb5-457e-944e-15d89d5a3f54 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:15.082160 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c3d8d178-eeb5-457e-944e-15d89d5a3f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:15.091571 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1352/2727] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:15.095849 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1bfa0-8223-4e2c-bc38-473c2822824e None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:15.106936 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1bfa0-8223-4e2c-bc38-473c2822824e None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:15.111535 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f425-f17a-4451-a1f8-78b7c53886fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:15.112195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f425-f17a-4451-a1f8-78b7c53886fc admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:15.112481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f425-f17a-4451-a1f8-78b7c53886fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:15.112756 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82f425-f17a-4451-a1f8-78b7c53886fc admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:15.113485 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82f425-f17a-4451-a1f8-78b7c53886fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:03:15.113827 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82f425-f17a-4451-a1f8-78b7c53886fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:15.115425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82f425-f17a-4451-a1f8-78b7c53886fc admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:15.127668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1376/2728] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:03:15.132450 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d178-eeb5-457e-944e-15d89d5a3f54 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:15.141786 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8d178-eeb5-457e-944e-15d89d5a3f54 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:15.146497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219fe9c-1948-4b9f-bd26-34e49a3e9f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:15.147148 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219fe9c-1948-4b9f-bd26-34e49a3e9f05 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:15.147435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219fe9c-1948-4b9f-bd26-34e49a3e9f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:15.147716 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219fe9c-1948-4b9f-bd26-34e49a3e9f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:15.148975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219fe9c-1948-4b9f-bd26-34e49a3e9f05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:15.150962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219fe9c-1948-4b9f-bd26-34e49a3e9f05 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:15.179832 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1353/2729] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:03:15 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:15.184544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f425-f17a-4451-a1f8-78b7c53886fc admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:15.194435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82f425-f17a-4451-a1f8-78b7c53886fc admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:15.248811 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212a43b-261e-4626-8be7-e7076bec1e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:15.249394 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212a43b-261e-4626-8be7-e7076bec1e39 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:15.249703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212a43b-261e-4626-8be7-e7076bec1e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:15.249979 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212a43b-261e-4626-8be7-e7076bec1e39 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:15.250682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212a43b-261e-4626-8be7-e7076bec1e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:15.252604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212a43b-261e-4626-8be7-e7076bec1e39 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:15.274455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1377/2730] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:03:15 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:15.278550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219fe9c-1948-4b9f-bd26-34e49a3e9f05 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:15.289747 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219fe9c-1948-4b9f-bd26-34e49a3e9f05 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:15.294328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07464d94-ff12-4004-a0fa-0bebefa14e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:15.295008 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07464d94-ff12-4004-a0fa-0bebefa14e56 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:15.295290 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07464d94-ff12-4004-a0fa-0bebefa14e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:15.295560 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07464d94-ff12-4004-a0fa-0bebefa14e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:15.296289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07464d94-ff12-4004-a0fa-0bebefa14e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:15.297959 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07464d94-ff12-4004-a0fa-0bebefa14e56 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:15.309301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1354/2731] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:15.313349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212a43b-261e-4626-8be7-e7076bec1e39 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:15.323797 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212a43b-261e-4626-8be7-e7076bec1e39 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:15.328784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018cb0a-a185-4e61-8b4e-e1f3e375daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:15.329497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018cb0a-a185-4e61-8b4e-e1f3e375daa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:15.329931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018cb0a-a185-4e61-8b4e-e1f3e375daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:15.330216 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018cb0a-a185-4e61-8b4e-e1f3e375daa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:15.330947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018cb0a-a185-4e61-8b4e-e1f3e375daa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:15.332542 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018cb0a-a185-4e61-8b4e-e1f3e375daa2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:15.343618 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1378/2732] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:15.347861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07464d94-ff12-4004-a0fa-0bebefa14e56 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:15.358262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07464d94-ff12-4004-a0fa-0bebefa14e56 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:15.362768 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d0239-e433-42c5-9af3-c227976446df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:15.363635 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d0239-e433-42c5-9af3-c227976446df admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:15.363915 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d0239-e433-42c5-9af3-c227976446df admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:15.364193 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d0239-e433-42c5-9af3-c227976446df admin admin] PATH_INFO: `/v3/projects/198d4b664eeb446b9fb8ecc0eb12aaea/users/152186dda5674956bc846c5daac48314/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:15.379020 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d0239-e433-42c5-9af3-c227976446df admin admin] RBAC: Authorizing `identity:create_grant(project_id=198d4b664eeb446b9fb8ecc0eb12aaea, user_id=152186dda5674956bc846c5daac48314, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:15.381722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d0239-e433-42c5-9af3-c227976446df admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:15.394987 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1355/2733] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:03:15 2022] PUT /identity/v3/projects/198d4b664eeb446b9fb8ecc0eb12aaea/users/152186dda5674956bc846c5daac48314/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:03:15.406037 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e141-a69d-4256-b85e-7c2f5565c8be None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:15.406323 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e141-a69d-4256-b85e-7c2f5565c8be None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:15.406597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e141-a69d-4256-b85e-7c2f5565c8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:15.433064 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-fdd0e141-a69d-4256-b85e-7c2f5565c8be None None] MFA Rules not processed for user `152186dda5674956bc846c5daac48314`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:15.434307 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-fdd0e141-a69d-4256-b85e-7c2f5565c8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:15.496196 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1379/2734] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:15.508882 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d0239-e433-42c5-9af3-c227976446df admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:15.510655 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-084d0239-e433-42c5-9af3-c227976446df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:15.566900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d0239-e433-42c5-9af3-c227976446df admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:15.571397 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d210a3-71bb-4fb0-9a15-6514b2347854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:15.572078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d210a3-71bb-4fb0-9a15-6514b2347854 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:15.572407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d210a3-71bb-4fb0-9a15-6514b2347854 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:15.572618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d210a3-71bb-4fb0-9a15-6514b2347854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:15.581009 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d210a3-71bb-4fb0-9a15-6514b2347854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:15.582524 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d210a3-71bb-4fb0-9a15-6514b2347854 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:15.592014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1356/2735] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:03:20.237634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e141-a69d-4256-b85e-7c2f5565c8be None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:20.302453 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e141-a69d-4256-b85e-7c2f5565c8be None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:20.307374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:20.308240 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:20.308513 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:20.308783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] PATH_INFO: `/v3/users/152186dda5674956bc846c5daac48314` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:20.309999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=152186dda5674956bc846c5daac48314)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:20.313403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:20.363458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152186dda5674956bc846c5daac48314'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:20.364107 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152186dda5674956bc846c5daac48314'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:20.364712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152186dda5674956bc846c5daac48314'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:20.377409 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152186dda5674956bc846c5daac48314'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:20.385378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152186dda5674956bc846c5daac48314'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:20.398203 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1380/2736] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:20 2022] DELETE /identity/v3/users/152186dda5674956bc846c5daac48314 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:20.403400 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edbcd1-171f-4e3c-a8e3-f1c865875a7e None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:20.403933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edbcd1-171f-4e3c-a8e3-f1c865875a7e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:20.403933 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edbcd1-171f-4e3c-a8e3-f1c865875a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:20.422092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-44edbcd1-171f-4e3c-a8e3-f1c865875a7e None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:20.423300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-44edbcd1-171f-4e3c-a8e3-f1c865875a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:20.485100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1357/2737] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:20.496784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:20.498742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:20.560257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1a511-99fe-4b3d-b99a-0debe08c63fd admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:20.565292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7bb38-eebb-4790-9be7-3ec6e2d5aeac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:20.566383 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7bb38-eebb-4790-9be7-3ec6e2d5aeac service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:20.566880 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7bb38-eebb-4790-9be7-3ec6e2d5aeac service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:20.567176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7bb38-eebb-4790-9be7-3ec6e2d5aeac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:20.578460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7bb38-eebb-4790-9be7-3ec6e2d5aeac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:20.579910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7bb38-eebb-4790-9be7-3ec6e2d5aeac service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:20.590691 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1381/2738] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:03:20.857411 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edbcd1-171f-4e3c-a8e3-f1c865875a7e None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:20.858961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-44edbcd1-171f-4e3c-a8e3-f1c865875a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:20.872373 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edbcd1-171f-4e3c-a8e3-f1c865875a7e None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:20.877719 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:20.878592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:20.878876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:20.879180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] PATH_INFO: `/v3/projects/198d4b664eeb446b9fb8ecc0eb12aaea` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:20.880558 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198d4b664eeb446b9fb8ecc0eb12aaea)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:20.882548 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:20.929494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198d4b664eeb446b9fb8ecc0eb12aaea', 'request_id': 'req-e8e963fe-97bb-42ad-a878-9252ece37bb5'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:20.935330 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198d4b664eeb446b9fb8ecc0eb12aaea', 'request_id': 'req-e8e963fe-97bb-42ad-a878-9252ece37bb5'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:20.942563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198d4b664eeb446b9fb8ecc0eb12aaea', 'request_id': 'req-e8e963fe-97bb-42ad-a878-9252ece37bb5'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:20.954303 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] The token cache is being invalidate because project 198d4b664eeb446b9fb8ecc0eb12aaea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:20.954591 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:20.955250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e8e963fe-97bb-42ad-a878-9252ece37bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:20.956819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1358/2739] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:20 2022] DELETE /identity/v3/projects/198d4b664eeb446b9fb8ecc0eb12aaea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:20.962459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426591-a2a0-4df6-a4bf-224a0f349303 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:20.962803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426591-a2a0-4df6-a4bf-224a0f349303 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:20.963050 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426591-a2a0-4df6-a4bf-224a0f349303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:20.982246 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-13426591-a2a0-4df6-a4bf-224a0f349303 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:20.983468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-13426591-a2a0-4df6-a4bf-224a0f349303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:21.043612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1382/2740] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:21.052507 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb672e-069f-4d37-8bad-0a6c62b293d4 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:21.052792 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb672e-069f-4d37-8bad-0a6c62b293d4 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:21.053065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb672e-069f-4d37-8bad-0a6c62b293d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:21.071939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-0dcb672e-069f-4d37-8bad-0a6c62b293d4 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:21.073137 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-0dcb672e-069f-4d37-8bad-0a6c62b293d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:21.081223 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1359/2741] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:21.140657 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426591-a2a0-4df6-a4bf-224a0f349303 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:21.151641 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426591-a2a0-4df6-a4bf-224a0f349303 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:21.156369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894eb4f5-13d4-4ae8-926a-bbad48a628b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:21.157031 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb4f5-13d4-4ae8-926a-bbad48a628b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:21.157314 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb4f5-13d4-4ae8-926a-bbad48a628b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:21.157615 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894eb4f5-13d4-4ae8-926a-bbad48a628b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:21.158349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894eb4f5-13d4-4ae8-926a-bbad48a628b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:03:21.158657 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894eb4f5-13d4-4ae8-926a-bbad48a628b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:21.160277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894eb4f5-13d4-4ae8-926a-bbad48a628b3 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:21.175003 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1383/2742] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:03:21.179543 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb672e-069f-4d37-8bad-0a6c62b293d4 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:21.189229 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb672e-069f-4d37-8bad-0a6c62b293d4 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:21.194152 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e8e08-bc62-41f7-be15-db6c67ef12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:21.194835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e8e08-bc62-41f7-be15-db6c67ef12bf admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:21.195118 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e8e08-bc62-41f7-be15-db6c67ef12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:21.195392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e8e08-bc62-41f7-be15-db6c67ef12bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:21.196902 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e8e08-bc62-41f7-be15-db6c67ef12bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:21.198907 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e8e08-bc62-41f7-be15-db6c67ef12bf admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:21.224348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1360/2743] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:03:21 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:21.229531 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894eb4f5-13d4-4ae8-926a-bbad48a628b3 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:21.239877 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894eb4f5-13d4-4ae8-926a-bbad48a628b3 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:21.431384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98b422-6321-46e5-ac18-3147ed108792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:21.432067 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98b422-6321-46e5-ac18-3147ed108792 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:21.432373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98b422-6321-46e5-ac18-3147ed108792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:21.432645 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98b422-6321-46e5-ac18-3147ed108792 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:21.433348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98b422-6321-46e5-ac18-3147ed108792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:21.435319 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98b422-6321-46e5-ac18-3147ed108792 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:21.455473 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1384/2744] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:03:21 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:21.460210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e8e08-bc62-41f7-be15-db6c67ef12bf admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:21.471530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e8e08-bc62-41f7-be15-db6c67ef12bf admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:21.478092 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43858363-a690-4dbc-8e0a-d5375eb0a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:21.479136 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43858363-a690-4dbc-8e0a-d5375eb0a16e admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:21.479348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43858363-a690-4dbc-8e0a-d5375eb0a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:21.479609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43858363-a690-4dbc-8e0a-d5375eb0a16e admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:21.480362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43858363-a690-4dbc-8e0a-d5375eb0a16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:21.482102 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43858363-a690-4dbc-8e0a-d5375eb0a16e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:21.495595 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1361/2745] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 13:03:21.500789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98b422-6321-46e5-ac18-3147ed108792 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:21.511207 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98b422-6321-46e5-ac18-3147ed108792 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:21.516778 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e65c1-065a-455a-a066-e25ca90835aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:21.517522 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e65c1-065a-455a-a066-e25ca90835aa admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:21.517913 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e65c1-065a-455a-a066-e25ca90835aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:21.518348 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e65c1-065a-455a-a066-e25ca90835aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:21.519020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e65c1-065a-455a-a066-e25ca90835aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:21.520711 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e65c1-065a-455a-a066-e25ca90835aa admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:21.531751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1385/2746] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:21.536374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43858363-a690-4dbc-8e0a-d5375eb0a16e admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:21.547341 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43858363-a690-4dbc-8e0a-d5375eb0a16e admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:21.551912 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caee8bf-eb6b-4b8e-a20c-fda5440f3d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:21.552796 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee8bf-eb6b-4b8e-a20c-fda5440f3d40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:21.553076 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee8bf-eb6b-4b8e-a20c-fda5440f3d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:21.553353 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee8bf-eb6b-4b8e-a20c-fda5440f3d40 admin admin] PATH_INFO: `/v3/projects/0c8bc3b24e6340d68f7e16a3cffea4a4/users/d707cd92b1684906a57b22b834417fdf/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:21.570798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caee8bf-eb6b-4b8e-a20c-fda5440f3d40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8bc3b24e6340d68f7e16a3cffea4a4, user_id=d707cd92b1684906a57b22b834417fdf, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:21.573695 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caee8bf-eb6b-4b8e-a20c-fda5440f3d40 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:21.588761 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1362/2747] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:03:21 2022] PUT /identity/v3/projects/0c8bc3b24e6340d68f7e16a3cffea4a4/users/d707cd92b1684906a57b22b834417fdf/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:21.593938 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0738a-e1bd-465e-9f50-d1fc0fd5513c None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:21.594221 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0738a-e1bd-465e-9f50-d1fc0fd5513c None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:21.594499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0738a-e1bd-465e-9f50-d1fc0fd5513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:21.612230 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-50e0738a-e1bd-465e-9f50-d1fc0fd5513c None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:21.613424 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-50e0738a-e1bd-465e-9f50-d1fc0fd5513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:21.672387 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1386/2748] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:21.683230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caee8bf-eb6b-4b8e-a20c-fda5440f3d40 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:21.684987 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6caee8bf-eb6b-4b8e-a20c-fda5440f3d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:21.741754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caee8bf-eb6b-4b8e-a20c-fda5440f3d40 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:21.746625 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de418dd4-b8cd-43c6-a342-3006b8d68c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:21.747283 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418dd4-b8cd-43c6-a342-3006b8d68c64 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:21.747569 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418dd4-b8cd-43c6-a342-3006b8d68c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:21.747849 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418dd4-b8cd-43c6-a342-3006b8d68c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:21.757230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de418dd4-b8cd-43c6-a342-3006b8d68c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:21.760033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de418dd4-b8cd-43c6-a342-3006b8d68c64 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:21.769983 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1363/2749] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:03:22.414262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f5bb-464a-4f49-9515-0b5ea84b2a67 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:22.415954 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f5bb-464a-4f49-9515-0b5ea84b2a67 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:22.416537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92f5bb-464a-4f49-9515-0b5ea84b2a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:22.449741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-0c92f5bb-464a-4f49-9515-0b5ea84b2a67 None None] MFA Rules not processed for user `d707cd92b1684906a57b22b834417fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:22.451296 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0c92f5bb-464a-4f49-9515-0b5ea84b2a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:22.530593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1387/2750] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:22.544597 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de418dd4-b8cd-43c6-a342-3006b8d68c64 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:22.546456 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-de418dd4-b8cd-43c6-a342-3006b8d68c64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:22.618828 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de418dd4-b8cd-43c6-a342-3006b8d68c64 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:22.622538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda5483-6087-46d9-912a-0a48ba08651e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:22.624662 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda5483-6087-46d9-912a-0a48ba08651e service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:22.624958 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda5483-6087-46d9-912a-0a48ba08651e service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:22.625235 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda5483-6087-46d9-912a-0a48ba08651e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:22.637485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda5483-6087-46d9-912a-0a48ba08651e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:22.638429 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda5483-6087-46d9-912a-0a48ba08651e service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:22.649930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1364/2751] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:03:24.046721 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a8b5c-46f9-430f-a349-4dc7601fdca0 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:24.047289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a8b5c-46f9-430f-a349-4dc7601fdca0 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:24.047289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a8b5c-46f9-430f-a349-4dc7601fdca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:24.064712 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b70a8b5c-46f9-430f-a349-4dc7601fdca0 None None] MFA Rules not processed for user `d707cd92b1684906a57b22b834417fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:24.065956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b70a8b5c-46f9-430f-a349-4dc7601fdca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:24.072870 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1388/2752] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:24.721594 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda5483-6087-46d9-912a-0a48ba08651e service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:24.723110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bfda5483-6087-46d9-912a-0a48ba08651e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:24.742260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda5483-6087-46d9-912a-0a48ba08651e service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:24.748061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:24.748809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:24.749087 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:24.749360 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] PATH_INFO: `/v3/users/6366e70bc13f4f4ea751d9f5dd6020b2` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:24.750586 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6366e70bc13f4f4ea751d9f5dd6020b2)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:24.752549 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:24.801737 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6366e70bc13f4f4ea751d9f5dd6020b2'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:24.802601 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6366e70bc13f4f4ea751d9f5dd6020b2'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:24.804432 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6366e70bc13f4f4ea751d9f5dd6020b2'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:24.812265 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6366e70bc13f4f4ea751d9f5dd6020b2'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:24.827718 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6366e70bc13f4f4ea751d9f5dd6020b2'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:24.841986 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1365/2753] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:24 2022] DELETE /identity/v3/users/6366e70bc13f4f4ea751d9f5dd6020b2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:24.846399 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5887-8506-4c57-9610-6386b5816564 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:24.847259 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5887-8506-4c57-9610-6386b5816564 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:24.847586 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5887-8506-4c57-9610-6386b5816564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:24.865499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-1b4e5887-8506-4c57-9610-6386b5816564 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:24.866714 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1b4e5887-8506-4c57-9610-6386b5816564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:24.933770 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1389/2754] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:24.940619 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:24.943313 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:25.010407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ee100-da30-4b14-b3a9-93d6399ea9cd admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:25.014299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ecc62-685e-4b63-99f0-8e97204859d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:25.014937 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ecc62-685e-4b63-99f0-8e97204859d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.015291 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ecc62-685e-4b63-99f0-8e97204859d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.015633 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ecc62-685e-4b63-99f0-8e97204859d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.025435 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ecc62-685e-4b63-99f0-8e97204859d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:25.027319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ecc62-685e-4b63-99f0-8e97204859d0 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:25.037408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1366/2755] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:03:25.374472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e5887-8506-4c57-9610-6386b5816564 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:25.375938 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-1b4e5887-8506-4c57-9610-6386b5816564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:25.388722 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e5887-8506-4c57-9610-6386b5816564 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:25.393361 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:25.394265 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.394550 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.394818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] PATH_INFO: `/v3/projects/dc6eaf4f88fd4a89992c9da46e800300` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.396024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6eaf4f88fd4a89992c9da46e800300)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:25.398004 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:25.461164 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6eaf4f88fd4a89992c9da46e800300', 'request_id': 'req-4e54eccc-aa89-406e-b93e-e4c61eeb336e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:25.467793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6eaf4f88fd4a89992c9da46e800300', 'request_id': 'req-4e54eccc-aa89-406e-b93e-e4c61eeb336e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:25.475018 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6eaf4f88fd4a89992c9da46e800300', 'request_id': 'req-4e54eccc-aa89-406e-b93e-e4c61eeb336e'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:25.486983 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] The token cache is being invalidate because project dc6eaf4f88fd4a89992c9da46e800300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:25.487335 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:25.488039 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4e54eccc-aa89-406e-b93e-e4c61eeb336e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:25.489671 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1390/2756] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:25 2022] DELETE /identity/v3/projects/dc6eaf4f88fd4a89992c9da46e800300 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:25.494800 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29638710-f724-4983-83dc-85745851d8dd None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.495113 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29638710-f724-4983-83dc-85745851d8dd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.495394 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29638710-f724-4983-83dc-85745851d8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.512951 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-29638710-f724-4983-83dc-85745851d8dd None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:25.514199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-29638710-f724-4983-83dc-85745851d8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:25.572667 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1367/2757] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:25.580617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b46c96-6a18-4544-bd6a-b47f1166a018 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.580922 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b46c96-6a18-4544-bd6a-b47f1166a018 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.581193 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b46c96-6a18-4544-bd6a-b47f1166a018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.601024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-d6b46c96-6a18-4544-bd6a-b47f1166a018 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:25.603098 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-d6b46c96-6a18-4544-bd6a-b47f1166a018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:25.611488 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1391/2758] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:25.615804 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29638710-f724-4983-83dc-85745851d8dd None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:25.625538 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29638710-f724-4983-83dc-85745851d8dd None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:25.630138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61671a45-4e75-416d-bfc1-45c53e15369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:25.630799 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61671a45-4e75-416d-bfc1-45c53e15369c admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.631081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61671a45-4e75-416d-bfc1-45c53e15369c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.631355 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61671a45-4e75-416d-bfc1-45c53e15369c admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.632084 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61671a45-4e75-416d-bfc1-45c53e15369c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:03:25.632390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61671a45-4e75-416d-bfc1-45c53e15369c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:25.634289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61671a45-4e75-416d-bfc1-45c53e15369c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:25.646777 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1368/2759] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:03:25.651834 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b46c96-6a18-4544-bd6a-b47f1166a018 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:25.661077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b46c96-6a18-4544-bd6a-b47f1166a018 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:25.666743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0c5cb-f6f4-4251-bf0d-a74ec4490e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:25.667403 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0c5cb-f6f4-4251-bf0d-a74ec4490e93 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.667685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0c5cb-f6f4-4251-bf0d-a74ec4490e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.667957 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0c5cb-f6f4-4251-bf0d-a74ec4490e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.668646 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0c5cb-f6f4-4251-bf0d-a74ec4490e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:25.670582 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0c5cb-f6f4-4251-bf0d-a74ec4490e93 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:25.697859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1392/2760] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:03:25 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:25.702809 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61671a45-4e75-416d-bfc1-45c53e15369c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:25.713441 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61671a45-4e75-416d-bfc1-45c53e15369c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:25.773285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e70a2-038f-451a-984c-8545f50ab376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:25.775301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e70a2-038f-451a-984c-8545f50ab376 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.775914 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e70a2-038f-451a-984c-8545f50ab376 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.776531 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e70a2-038f-451a-984c-8545f50ab376 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.777854 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e70a2-038f-451a-984c-8545f50ab376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:25.781758 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e70a2-038f-451a-984c-8545f50ab376 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:25.804072 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1369/2761] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:03:25 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:03:25.808904 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0c5cb-f6f4-4251-bf0d-a74ec4490e93 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:25.819262 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0c5cb-f6f4-4251-bf0d-a74ec4490e93 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:25.824404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603519b-bb91-4404-816d-09744404758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:25.825055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603519b-bb91-4404-816d-09744404758c admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.825337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603519b-bb91-4404-816d-09744404758c admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.825652 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603519b-bb91-4404-816d-09744404758c admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.826380 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603519b-bb91-4404-816d-09744404758c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:25.827975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603519b-bb91-4404-816d-09744404758c admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:25.838825 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1393/2762] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:25.842926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e70a2-038f-451a-984c-8545f50ab376 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:25.852971 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e70a2-038f-451a-984c-8545f50ab376 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:25.857733 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8606ea-7fb7-4482-a6ef-1df4aa60db7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:25.858392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8606ea-7fb7-4482-a6ef-1df4aa60db7e admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.858671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8606ea-7fb7-4482-a6ef-1df4aa60db7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.858949 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8606ea-7fb7-4482-a6ef-1df4aa60db7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.859671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8606ea-7fb7-4482-a6ef-1df4aa60db7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:25.861325 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8606ea-7fb7-4482-a6ef-1df4aa60db7e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:25.871250 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1370/2763] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:03:25.875289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603519b-bb91-4404-816d-09744404758c admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:25.886780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603519b-bb91-4404-816d-09744404758c admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:25.892493 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c94897-8458-4b11-a9bc-b5304e79fb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:25.893390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94897-8458-4b11-a9bc-b5304e79fb46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.893727 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94897-8458-4b11-a9bc-b5304e79fb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.893993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c94897-8458-4b11-a9bc-b5304e79fb46 admin admin] PATH_INFO: `/v3/projects/92270792fa7b4b62aaf473329aa659e8/users/69b6c70386634657a4b6e96faaed67e4/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.911603 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c94897-8458-4b11-a9bc-b5304e79fb46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92270792fa7b4b62aaf473329aa659e8, user_id=69b6c70386634657a4b6e96faaed67e4, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:25.915532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c94897-8458-4b11-a9bc-b5304e79fb46 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:25.929201 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1394/2764] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:03:25 2022] PUT /identity/v3/projects/92270792fa7b4b62aaf473329aa659e8/users/69b6c70386634657a4b6e96faaed67e4/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:25.940532 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3ae56-4409-4f8c-a0c4-fa420c920e7e None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:25.940818 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3ae56-4409-4f8c-a0c4-fa420c920e7e None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:25.941099 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3ae56-4409-4f8c-a0c4-fa420c920e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:25.969208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-1dd3ae56-4409-4f8c-a0c4-fa420c920e7e None None] MFA Rules not processed for user `69b6c70386634657a4b6e96faaed67e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:25.970363 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-1dd3ae56-4409-4f8c-a0c4-fa420c920e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:26.036449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1371/2765] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:26.048175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c94897-8458-4b11-a9bc-b5304e79fb46 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:26.049923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e7c94897-8458-4b11-a9bc-b5304e79fb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:26.105595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c94897-8458-4b11-a9bc-b5304e79fb46 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:26.109271 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67009a00-86b4-4e8a-91f8-6160ce7f54c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:26.109965 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009a00-86b4-4e8a-91f8-6160ce7f54c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:26.110247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009a00-86b4-4e8a-91f8-6160ce7f54c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:26.110525 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67009a00-86b4-4e8a-91f8-6160ce7f54c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:26.119560 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67009a00-86b4-4e8a-91f8-6160ce7f54c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:26.120984 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67009a00-86b4-4e8a-91f8-6160ce7f54c6 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:26.129858 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1395/2766] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:03:27.479142 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a899-ece7-42a6-8bce-6546d9319680 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:27.479734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a899-ece7-42a6-8bce-6546d9319680 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:27.479734 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a899-ece7-42a6-8bce-6546d9319680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:27.500162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-a872a899-ece7-42a6-8bce-6546d9319680 None None] MFA Rules not processed for user `69b6c70386634657a4b6e96faaed67e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:27.501469 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-a872a899-ece7-42a6-8bce-6546d9319680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:27.510419 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1372/2767] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:33.495752 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d4e90-f5f0-42cd-8905-fdbaeb00f24f None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:33.496369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d4e90-f5f0-42cd-8905-fdbaeb00f24f None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:33.496369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d4e90-f5f0-42cd-8905-fdbaeb00f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:33.517149 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3e0d4e90-f5f0-42cd-8905-fdbaeb00f24f None None] MFA Rules not processed for user `db5913ed289942bc9a57c25b9c0e2e46`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:33.518673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3e0d4e90-f5f0-42cd-8905-fdbaeb00f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:33.580080 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1396/2768] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:45.816470 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7fa2a-73a9-4cf9-aa8a-784eb6fdc3ea None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:45.817043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7fa2a-73a9-4cf9-aa8a-784eb6fdc3ea None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:45.817043 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7fa2a-73a9-4cf9-aa8a-784eb6fdc3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:45.836318 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-5ac7fa2a-73a9-4cf9-aa8a-784eb6fdc3ea None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:45.838090 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-5ac7fa2a-73a9-4cf9-aa8a-784eb6fdc3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:45.898929 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1373/2769] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 13:03:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:03:45.957217 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d4e90-f5f0-42cd-8905-fdbaeb00f24f None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:45.958683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3e0d4e90-f5f0-42cd-8905-fdbaeb00f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:46.045458 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d4e90-f5f0-42cd-8905-fdbaeb00f24f None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:46.050345 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22107b9-62f6-45f1-b769-2d3c8d781a76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:46.050982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22107b9-62f6-45f1-b769-2d3c8d781a76 service swift] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:46.051382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22107b9-62f6-45f1-b769-2d3c8d781a76 service swift] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:46.051655 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22107b9-62f6-45f1-b769-2d3c8d781a76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:46.060598 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22107b9-62f6-45f1-b769-2d3c8d781a76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:46.062289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22107b9-62f6-45f1-b769-2d3c8d781a76 service swift] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:46.071884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1397/2770] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 13:03:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 13:03:46.629539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb969bf-cabb-43ad-be78-7307375ea53a None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:46.629896 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb969bf-cabb-43ad-be78-7307375ea53a None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:46.630587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb969bf-cabb-43ad-be78-7307375ea53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:46.653338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-ffb969bf-cabb-43ad-be78-7307375ea53a None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:46.654627 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ffb969bf-cabb-43ad-be78-7307375ea53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:46.662141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1374/2771] 10.222.0.23 () {58 vars in 967 bytes} [Wed Apr 6 13:03:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:46.676595 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22107b9-62f6-45f1-b769-2d3c8d781a76 service swift] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:46.688332 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22107b9-62f6-45f1-b769-2d3c8d781a76 service swift] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:46.700224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cc411-ca7d-4488-843f-794f8341c0a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:46.701492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cc411-ca7d-4488-843f-794f8341c0a8 service swift] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:46.701859 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cc411-ca7d-4488-843f-794f8341c0a8 service swift] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:46.702154 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cc411-ca7d-4488-843f-794f8341c0a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:46.710651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cc411-ca7d-4488-843f-794f8341c0a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:46.712626 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598cc411-ca7d-4488-843f-794f8341c0a8 service swift] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:46.720982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1398/2772] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 13:03:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 13:03:46.934976 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e66c-fd60-4bb3-b1e2-dcb4d19976bb None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:46.935530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e66c-fd60-4bb3-b1e2-dcb4d19976bb None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:46.935530 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e66c-fd60-4bb3-b1e2-dcb4d19976bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:46.954590 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-e7d9e66c-fd60-4bb3-b1e2-dcb4d19976bb None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:46.955791 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e7d9e66c-fd60-4bb3-b1e2-dcb4d19976bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:46.965119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1375/2773] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 13:03:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:46.977544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cc411-ca7d-4488-843f-794f8341c0a8 service swift] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:46.988237 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598cc411-ca7d-4488-843f-794f8341c0a8 service swift] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:46.994281 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad52d78-2a97-4be6-a8b3-be10d10362ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:46.995163 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad52d78-2a97-4be6-a8b3-be10d10362ae service swift] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:46.995435 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad52d78-2a97-4be6-a8b3-be10d10362ae service swift] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:46.995713 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad52d78-2a97-4be6-a8b3-be10d10362ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:47.004464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad52d78-2a97-4be6-a8b3-be10d10362ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:47.006083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad52d78-2a97-4be6-a8b3-be10d10362ae service swift] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:47.015035 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1399/2774] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 13:03:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 13:03:47.360823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc34da-0d6e-431a-ae9e-db9ab981effb None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:47.361110 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc34da-0d6e-431a-ae9e-db9ab981effb None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:47.361387 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc34da-0d6e-431a-ae9e-db9ab981effb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:47.380135 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-7bbc34da-0d6e-431a-ae9e-db9ab981effb None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:47.381369 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7bbc34da-0d6e-431a-ae9e-db9ab981effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:47.389657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1376/2775] 10.222.0.23 () {58 vars in 967 bytes} [Wed Apr 6 13:03:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:47.410966 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad52d78-2a97-4be6-a8b3-be10d10362ae service swift] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:47.421563 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad52d78-2a97-4be6-a8b3-be10d10362ae service swift] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:47.427026 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68729f-09ae-449e-9503-51387f0212c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:47.428459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68729f-09ae-449e-9503-51387f0212c1 service swift] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:47.429167 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68729f-09ae-449e-9503-51387f0212c1 service swift] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:47.430185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68729f-09ae-449e-9503-51387f0212c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:47.441097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68729f-09ae-449e-9503-51387f0212c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:47.442761 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68729f-09ae-449e-9503-51387f0212c1 service swift] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:47.452808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1400/2776] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 13:03:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 13:03:49.661079 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc34da-0d6e-431a-ae9e-db9ab981effb None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:49.723162 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc34da-0d6e-431a-ae9e-db9ab981effb None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:49.728338 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:49.729207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:49.729491 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:49.729798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] PATH_INFO: `/v3/users/69b6c70386634657a4b6e96faaed67e4` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:49.731004 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69b6c70386634657a4b6e96faaed67e4)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:49.732948 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:49.777478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69b6c70386634657a4b6e96faaed67e4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:49.778157 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69b6c70386634657a4b6e96faaed67e4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:49.778766 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69b6c70386634657a4b6e96faaed67e4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:49.785356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69b6c70386634657a4b6e96faaed67e4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:49.799850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69b6c70386634657a4b6e96faaed67e4'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:49.813063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1377/2777] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:03:49 2022] DELETE /identity/v3/users/69b6c70386634657a4b6e96faaed67e4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:03:49.817679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eaba7-95b0-4222-9f1c-7499a60e0df8 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:49.818443 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eaba7-95b0-4222-9f1c-7499a60e0df8 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:49.818629 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787eaba7-95b0-4222-9f1c-7499a60e0df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:49.836224 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-787eaba7-95b0-4222-9f1c-7499a60e0df8 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:03:49.837402 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-787eaba7-95b0-4222-9f1c-7499a60e0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:49.893113 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1401/2778] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:03:49.902676 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:49.904067 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:49.962327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d11a9-6a9d-4bdd-9062-3afa9289fd43 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:49.966033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78409fde-2bda-49dc-a346-94f4d504527b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:49.966683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78409fde-2bda-49dc-a346-94f4d504527b service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:49.966967 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78409fde-2bda-49dc-a346-94f4d504527b service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:49.967244 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78409fde-2bda-49dc-a346-94f4d504527b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:49.976892 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78409fde-2bda-49dc-a346-94f4d504527b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:49.978651 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78409fde-2bda-49dc-a346-94f4d504527b service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:49.988175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1378/2779] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:03:50.153956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eaba7-95b0-4222-9f1c-7499a60e0df8 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:03:50.155376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-787eaba7-95b0-4222-9f1c-7499a60e0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:03:50.169070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787eaba7-95b0-4222-9f1c-7499a60e0df8 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:03:50.174853 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:03:50.175732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:03:50.176012 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:03:50.176283 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] PATH_INFO: `/v3/projects/92270792fa7b4b62aaf473329aa659e8` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:03:50.177518 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92270792fa7b4b62aaf473329aa659e8)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:03:50.179563 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:03:50.225329 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92270792fa7b4b62aaf473329aa659e8', 'request_id': 'req-e1f288cd-4446-4381-84bf-d1b1cd1674f2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:50.233247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92270792fa7b4b62aaf473329aa659e8', 'request_id': 'req-e1f288cd-4446-4381-84bf-d1b1cd1674f2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:50.241213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92270792fa7b4b62aaf473329aa659e8', 'request_id': 'req-e1f288cd-4446-4381-84bf-d1b1cd1674f2'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:50.253045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] The token cache is being invalidate because project 92270792fa7b4b62aaf473329aa659e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:03:50.253466 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:50.254289 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:03:50.256074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1402/2780] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:03:50 2022] DELETE /identity/v3/projects/92270792fa7b4b62aaf473329aa659e8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:04:36.486773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef224a-efff-4eda-86f7-0a32aae55f3f None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:04:36.487420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef224a-efff-4eda-86f7-0a32aae55f3f None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:04:36.487420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef224a-efff-4eda-86f7-0a32aae55f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:04:36.504638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-abef224a-efff-4eda-86f7-0a32aae55f3f None None] MFA Rules not processed for user `d707cd92b1684906a57b22b834417fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:04:36.505904 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-abef224a-efff-4eda-86f7-0a32aae55f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:04:36.635140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1379/2781] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:04:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:04:39.691385 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:04:39.694940 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:04:39.755751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f288cd-4446-4381-84bf-d1b1cd1674f2 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:04:39.760191 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633a4c7-484d-4d8a-935e-7c33776cd75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:04:39.761309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633a4c7-484d-4d8a-935e-7c33776cd75e service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:04:39.761309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633a4c7-484d-4d8a-935e-7c33776cd75e service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:04:39.761538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633a4c7-484d-4d8a-935e-7c33776cd75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:04:39.763298 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4633a4c7-484d-4d8a-935e-7c33776cd75e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:04:39.828685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633a4c7-484d-4d8a-935e-7c33776cd75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:04:39.830185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4633a4c7-484d-4d8a-935e-7c33776cd75e service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:04:39.841751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1403/2782] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:04:47.399753 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef224a-efff-4eda-86f7-0a32aae55f3f None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:04:47.401452 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-abef224a-efff-4eda-86f7-0a32aae55f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:04:47.420094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef224a-efff-4eda-86f7-0a32aae55f3f None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:04:47.424735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:04:47.425674 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:04:47.425954 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:04:47.426279 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] PATH_INFO: `/v3/users/ef623fa30c4647e18d9dd3f81704e0ab` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:04:47.427440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef623fa30c4647e18d9dd3f81704e0ab)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:04:47.429449 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:04:47.479963 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef623fa30c4647e18d9dd3f81704e0ab'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:47.480736 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef623fa30c4647e18d9dd3f81704e0ab'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:47.481398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef623fa30c4647e18d9dd3f81704e0ab'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:47.489147 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef623fa30c4647e18d9dd3f81704e0ab'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:47.504034 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef623fa30c4647e18d9dd3f81704e0ab'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:47.525392 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1380/2783] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:04:47 2022] DELETE /identity/v3/users/ef623fa30c4647e18d9dd3f81704e0ab => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:04:47.731150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633a4c7-484d-4d8a-935e-7c33776cd75e service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:04:47.742561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633a4c7-484d-4d8a-935e-7c33776cd75e service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:04:47.800186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:04:47.800964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:04:47.801242 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:04:47.801505 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] PATH_INFO: `/v3/projects/6906900165724dd285750b2a09b92b66` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:04:47.802696 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6906900165724dd285750b2a09b92b66)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:04:47.805648 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:04:47.854946 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6906900165724dd285750b2a09b92b66', 'request_id': 'req-e75785f9-74c3-4bde-94c8-5330a73a8fab'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:47.861036 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6906900165724dd285750b2a09b92b66', 'request_id': 'req-e75785f9-74c3-4bde-94c8-5330a73a8fab'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:47.869641 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6906900165724dd285750b2a09b92b66', 'request_id': 'req-e75785f9-74c3-4bde-94c8-5330a73a8fab'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:47.880498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] The token cache is being invalidate because project 6906900165724dd285750b2a09b92b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:04:47.880927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:47.882236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:47.883986 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1404/2784] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:04:47 2022] DELETE /identity/v3/projects/6906900165724dd285750b2a09b92b66 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:04:47.888280 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:04:47.889757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:04:47.904324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc02936-57c5-4514-a765-1857bec30d96 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:04:47.962444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:04:47.963319 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:04:47.963602 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:04:47.963876 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] PATH_INFO: `/v3/users/88f8874ff4194925960c748e01ede56b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:04:47.965080 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f8874ff4194925960c748e01ede56b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:04:47.967047 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:04:48.019898 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f8874ff4194925960c748e01ede56b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:48.020550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f8874ff4194925960c748e01ede56b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:48.021163 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f8874ff4194925960c748e01ede56b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:48.027810 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f8874ff4194925960c748e01ede56b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:48.039689 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f8874ff4194925960c748e01ede56b'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:48.052362 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1381/2785] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:04:47 2022] DELETE /identity/v3/users/88f8874ff4194925960c748e01ede56b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:04:48.238908 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:04:48.240356 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:04:48.257479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75785f9-74c3-4bde-94c8-5330a73a8fab admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:04:48.323176 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:04:48.324743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:04:48.324743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:04:48.324743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] PATH_INFO: `/v3/projects/ffd1a2290fa344c692bd4100baddeec0` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:04:48.326074 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd1a2290fa344c692bd4100baddeec0)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:04:48.328155 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:04:48.377771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd1a2290fa344c692bd4100baddeec0', 'request_id': 'req-4ddcc189-2a79-4709-bf49-f68e59ba42f5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:48.384749 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd1a2290fa344c692bd4100baddeec0', 'request_id': 'req-4ddcc189-2a79-4709-bf49-f68e59ba42f5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:48.395108 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd1a2290fa344c692bd4100baddeec0', 'request_id': 'req-4ddcc189-2a79-4709-bf49-f68e59ba42f5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:48.408887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] The token cache is being invalidate because project ffd1a2290fa344c692bd4100baddeec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:04:48.409173 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:48.409852 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:04:48.411452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1405/2786] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:04:48 2022] DELETE /identity/v3/projects/ffd1a2290fa344c692bd4100baddeec0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:04:59.613883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:04:59.615879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:04:59.671361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9b12c-959f-4527-9846-a7513a871ab5 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:04:59.720486 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64fffd-f5d4-4f25-afe4-32f73606e189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:04:59.721129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64fffd-f5d4-4f25-afe4-32f73606e189 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:04:59.721407 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64fffd-f5d4-4f25-afe4-32f73606e189 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:04:59.721722 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64fffd-f5d4-4f25-afe4-32f73606e189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:04:59.723496 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ca64fffd-f5d4-4f25-afe4-32f73606e189 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:04:59.790585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64fffd-f5d4-4f25-afe4-32f73606e189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:04:59.792037 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64fffd-f5d4-4f25-afe4-32f73606e189 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:04:59.802657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1382/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:04:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:05:04.777544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:04.779081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:04.835187 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcc189-2a79-4709-bf49-f68e59ba42f5 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:04.839676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd02aa-11c3-473b-bfdf-117abae8a006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:04.839676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd02aa-11c3-473b-bfdf-117abae8a006 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:04.839676 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd02aa-11c3-473b-bfdf-117abae8a006 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:04.840053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd02aa-11c3-473b-bfdf-117abae8a006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:04.841658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0dbd02aa-11c3-473b-bfdf-117abae8a006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:04.854950 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd02aa-11c3-473b-bfdf-117abae8a006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:04.856376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd02aa-11c3-473b-bfdf-117abae8a006 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:04.867577 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1406/2788] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:05:15.336486 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64fffd-f5d4-4f25-afe4-32f73606e189 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:15.338035 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-ca64fffd-f5d4-4f25-afe4-32f73606e189 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:15.350108 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64fffd-f5d4-4f25-afe4-32f73606e189 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:15.354570 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83216e0d-c815-4d21-874c-80d93db26b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:15.355213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216e0d-c815-4d21-874c-80d93db26b0c service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:15.355497 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216e0d-c815-4d21-874c-80d93db26b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:15.355767 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216e0d-c815-4d21-874c-80d93db26b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:15.357513 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-83216e0d-c815-4d21-874c-80d93db26b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:15.423856 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83216e0d-c815-4d21-874c-80d93db26b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:15.425517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83216e0d-c815-4d21-874c-80d93db26b0c service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:15.436894 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1383/2789] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:05:17.166046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd02aa-11c3-473b-bfdf-117abae8a006 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:17.167657 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0dbd02aa-11c3-473b-bfdf-117abae8a006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:17.183390 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd02aa-11c3-473b-bfdf-117abae8a006 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:17.187935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:17.188803 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:17.189083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:17.189354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] PATH_INFO: `/v3/users/db5913ed289942bc9a57c25b9c0e2e46` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:17.190584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5913ed289942bc9a57c25b9c0e2e46)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:17.192504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:17.244043 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5913ed289942bc9a57c25b9c0e2e46'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:17.244702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5913ed289942bc9a57c25b9c0e2e46'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:17.245309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5913ed289942bc9a57c25b9c0e2e46'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:17.258575 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5913ed289942bc9a57c25b9c0e2e46'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:17.267502 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-54584783-14a6-4258-aeb4-8ba676c384c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5913ed289942bc9a57c25b9c0e2e46'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:17.283468 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1407/2790] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:05:17 2022] DELETE /identity/v3/users/db5913ed289942bc9a57c25b9c0e2e46 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:17.457277 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83216e0d-c815-4d21-874c-80d93db26b0c service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:17.468286 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83216e0d-c815-4d21-874c-80d93db26b0c service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:17.526559 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:17.527423 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:17.527704 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:17.527978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] PATH_INFO: `/v3/projects/f566084a0b414e6dabf96eae8ae4d7ac` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:17.529177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f566084a0b414e6dabf96eae8ae4d7ac)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:17.531149 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:17.576764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f566084a0b414e6dabf96eae8ae4d7ac', 'request_id': 'req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:17.581771 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f566084a0b414e6dabf96eae8ae4d7ac', 'request_id': 'req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:17.589823 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f566084a0b414e6dabf96eae8ae4d7ac', 'request_id': 'req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:17.601445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] The token cache is being invalidate because project f566084a0b414e6dabf96eae8ae4d7ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:05:17.601740 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:17.602381 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-e0a2cc0c-c29b-46e6-b4a9-d4bbe3cd857c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:17.603927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1384/2791] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:05:17 2022] DELETE /identity/v3/projects/f566084a0b414e6dabf96eae8ae4d7ac => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:17.608918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4799a-0f02-48b9-87d1-f73f66ef68ae None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:17.609213 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4799a-0f02-48b9-87d1-f73f66ef68ae None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:17.609489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4799a-0f02-48b9-87d1-f73f66ef68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:17.627447 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b6d4799a-0f02-48b9-87d1-f73f66ef68ae None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:17.628651 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b6d4799a-0f02-48b9-87d1-f73f66ef68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:17.690178 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1408/2792] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:17.698262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25858-5281-497e-9bd1-1d428c4b7cdd None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:17.698551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25858-5281-497e-9bd1-1d428c4b7cdd None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:17.698830 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25858-5281-497e-9bd1-1d428c4b7cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:17.717525 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b1a25858-5281-497e-9bd1-1d428c4b7cdd None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:17.718754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b1a25858-5281-497e-9bd1-1d428c4b7cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:17.727288 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1385/2793] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:17.731677 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4799a-0f02-48b9-87d1-f73f66ef68ae None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:17.741382 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4799a-0f02-48b9-87d1-f73f66ef68ae None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:17.745953 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249fab0-498e-4b90-8a92-94b5563a01ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:17.746623 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249fab0-498e-4b90-8a92-94b5563a01ed admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:17.746898 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249fab0-498e-4b90-8a92-94b5563a01ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:17.747168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249fab0-498e-4b90-8a92-94b5563a01ed admin admin] PATH_INFO: `/v3/domains` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:17.747897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249fab0-498e-4b90-8a92-94b5563a01ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:05:17.748200 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249fab0-498e-4b90-8a92-94b5563a01ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:17.749819 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249fab0-498e-4b90-8a92-94b5563a01ed admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:17.765373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1409/2794] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:05:17.766568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25858-5281-497e-9bd1-1d428c4b7cdd None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:17.776656 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a25858-5281-497e-9bd1-1d428c4b7cdd None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:17.781516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ffd9b-be83-4aaa-905b-2a34ab44aa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:17.782208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffd9b-be83-4aaa-905b-2a34ab44aa77 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:17.782495 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffd9b-be83-4aaa-905b-2a34ab44aa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:17.782769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffd9b-be83-4aaa-905b-2a34ab44aa77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:17.783502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ffd9b-be83-4aaa-905b-2a34ab44aa77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:17.785440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ffd9b-be83-4aaa-905b-2a34ab44aa77 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:17.812818 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1386/2795] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:05:17 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:17.817517 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249fab0-498e-4b90-8a92-94b5563a01ed admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:17.827524 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249fab0-498e-4b90-8a92-94b5563a01ed admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:17.882982 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a8948-c6a4-4830-982b-683a611712d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:17.883650 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a8948-c6a4-4830-982b-683a611712d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:17.883930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a8948-c6a4-4830-982b-683a611712d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:17.884199 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a8948-c6a4-4830-982b-683a611712d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:17.884897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a8948-c6a4-4830-982b-683a611712d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:17.886832 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a8948-c6a4-4830-982b-683a611712d5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:17.907630 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1410/2796] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:05:17 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:17.911927 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ffd9b-be83-4aaa-905b-2a34ab44aa77 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:17.923730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ffd9b-be83-4aaa-905b-2a34ab44aa77 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:17.928581 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aafc4-8335-4428-98b9-f9cfebc5b44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:17.929262 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aafc4-8335-4428-98b9-f9cfebc5b44c admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:17.929563 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aafc4-8335-4428-98b9-f9cfebc5b44c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:17.929854 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6aafc4-8335-4428-98b9-f9cfebc5b44c admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:17.930607 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aafc4-8335-4428-98b9-f9cfebc5b44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:17.932240 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6aafc4-8335-4428-98b9-f9cfebc5b44c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:17.942964 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1387/2797] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:17.948009 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a8948-c6a4-4830-982b-683a611712d5 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:17.958315 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a8948-c6a4-4830-982b-683a611712d5 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:17.963556 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936cc4e0-731f-41c0-abe8-27111889857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:17.964238 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc4e0-731f-41c0-abe8-27111889857b admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:17.964498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc4e0-731f-41c0-abe8-27111889857b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:17.964771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936cc4e0-731f-41c0-abe8-27111889857b admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:17.965499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cc4e0-731f-41c0-abe8-27111889857b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:17.967114 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936cc4e0-731f-41c0-abe8-27111889857b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:17.979369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1411/2798] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:17.984232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aafc4-8335-4428-98b9-f9cfebc5b44c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:17.997939 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6aafc4-8335-4428-98b9-f9cfebc5b44c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:18.003380 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d4f4f-04b9-43c9-ac79-3bf5ce1b9c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:18.004329 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d4f4f-04b9-43c9-ac79-3bf5ce1b9c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:18.004624 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d4f4f-04b9-43c9-ac79-3bf5ce1b9c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:18.004905 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d4f4f-04b9-43c9-ac79-3bf5ce1b9c31 admin admin] PATH_INFO: `/v3/projects/96de8723969a4193bb8677238a0235dc/users/460de69fa53d4203867aa367ffcf8e3f/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:18.022494 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d4f4f-04b9-43c9-ac79-3bf5ce1b9c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96de8723969a4193bb8677238a0235dc, user_id=460de69fa53d4203867aa367ffcf8e3f, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:18.025724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d4f4f-04b9-43c9-ac79-3bf5ce1b9c31 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:18.041236 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1388/2799] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:05:17 2022] PUT /identity/v3/projects/96de8723969a4193bb8677238a0235dc/users/460de69fa53d4203867aa367ffcf8e3f/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:18.051741 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e03ef-a82f-49f4-86a2-197d6c2c8f56 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:18.052171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e03ef-a82f-49f4-86a2-197d6c2c8f56 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:18.052451 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e03ef-a82f-49f4-86a2-197d6c2c8f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:18.078848 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-983e03ef-a82f-49f4-86a2-197d6c2c8f56 None None] MFA Rules not processed for user `460de69fa53d4203867aa367ffcf8e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:18.079955 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-983e03ef-a82f-49f4-86a2-197d6c2c8f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:18.144100 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1412/2800] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:18.149409 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d4f4f-04b9-43c9-ac79-3bf5ce1b9c31 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:18.211919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d4f4f-04b9-43c9-ac79-3bf5ce1b9c31 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:18.216650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b91e6-98fd-495e-b68f-4db7f26f2d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:18.217311 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b91e6-98fd-495e-b68f-4db7f26f2d92 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:18.217620 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b91e6-98fd-495e-b68f-4db7f26f2d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:18.217906 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b91e6-98fd-495e-b68f-4db7f26f2d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:18.218610 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b91e6-98fd-495e-b68f-4db7f26f2d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:18.220550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b91e6-98fd-495e-b68f-4db7f26f2d92 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:18.249314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1389/2801] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:05:18 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:18.253606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e03ef-a82f-49f4-86a2-197d6c2c8f56 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:18.266464 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e03ef-a82f-49f4-86a2-197d6c2c8f56 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:18.332738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb29147-7f91-427d-bcd9-61b34b36fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:18.333274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb29147-7f91-427d-bcd9-61b34b36fa57 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:18.333559 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb29147-7f91-427d-bcd9-61b34b36fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:18.333860 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb29147-7f91-427d-bcd9-61b34b36fa57 admin admin] PATH_INFO: `/v3/users` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:18.334742 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb29147-7f91-427d-bcd9-61b34b36fa57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:18.337020 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb29147-7f91-427d-bcd9-61b34b36fa57 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:18.356703 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1413/2802] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:05:18 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:18.360900 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b91e6-98fd-495e-b68f-4db7f26f2d92 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:18.372115 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b91e6-98fd-495e-b68f-4db7f26f2d92 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:18.376778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae846dfe-6f54-4d35-b1e8-db0834c4d0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:18.377439 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae846dfe-6f54-4d35-b1e8-db0834c4d0cd admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:18.377764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae846dfe-6f54-4d35-b1e8-db0834c4d0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:18.378046 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae846dfe-6f54-4d35-b1e8-db0834c4d0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:18.378767 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae846dfe-6f54-4d35-b1e8-db0834c4d0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:18.380391 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae846dfe-6f54-4d35-b1e8-db0834c4d0cd admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:18.392194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1390/2803] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:18.396735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb29147-7f91-427d-bcd9-61b34b36fa57 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:18.406818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb29147-7f91-427d-bcd9-61b34b36fa57 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:18.411450 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07d0d1-1c40-4378-83af-21bdc0bfe4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:18.412341 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07d0d1-1c40-4378-83af-21bdc0bfe4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:18.412774 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07d0d1-1c40-4378-83af-21bdc0bfe4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:18.413052 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07d0d1-1c40-4378-83af-21bdc0bfe4fd admin admin] PATH_INFO: `/v3/projects/b8bcc97d57714eb3a5b9d11bb3573bf5/users/530a3123af2b4255b861e72eeb1a0179/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:18.429158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07d0d1-1c40-4378-83af-21bdc0bfe4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bcc97d57714eb3a5b9d11bb3573bf5, user_id=530a3123af2b4255b861e72eeb1a0179, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:18.431861 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07d0d1-1c40-4378-83af-21bdc0bfe4fd admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:18.445729 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1414/2804] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:05:18 2022] PUT /identity/v3/projects/b8bcc97d57714eb3a5b9d11bb3573bf5/users/530a3123af2b4255b861e72eeb1a0179/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:18.449743 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae846dfe-6f54-4d35-b1e8-db0834c4d0cd admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:18.460568 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae846dfe-6f54-4d35-b1e8-db0834c4d0cd admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:18.517141 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b19c45-4370-4675-809f-ac38b848701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:18.517840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b19c45-4370-4675-809f-ac38b848701a admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:18.518129 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b19c45-4370-4675-809f-ac38b848701a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:18.518402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b19c45-4370-4675-809f-ac38b848701a admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:18.519124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b19c45-4370-4675-809f-ac38b848701a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:18.520746 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b19c45-4370-4675-809f-ac38b848701a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:18.530847 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1391/2805] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:18.535183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07d0d1-1c40-4378-83af-21bdc0bfe4fd admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:18.545909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07d0d1-1c40-4378-83af-21bdc0bfe4fd admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:18.550529 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b980fa0-f726-4943-b21e-b3baba563a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:18.551405 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980fa0-f726-4943-b21e-b3baba563a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:18.551679 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980fa0-f726-4943-b21e-b3baba563a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:18.551948 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b980fa0-f726-4943-b21e-b3baba563a40 admin admin] PATH_INFO: `/v3/projects/b8bcc97d57714eb3a5b9d11bb3573bf5/users/530a3123af2b4255b861e72eeb1a0179/roles/c158bb1781c44a03890992161076b84b` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:18.554449 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b980fa0-f726-4943-b21e-b3baba563a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bcc97d57714eb3a5b9d11bb3573bf5, user_id=530a3123af2b4255b861e72eeb1a0179, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:18.557053 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b980fa0-f726-4943-b21e-b3baba563a40 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:18.567536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1415/2806] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:05:18 2022] PUT /identity/v3/projects/b8bcc97d57714eb3a5b9d11bb3573bf5/users/530a3123af2b4255b861e72eeb1a0179/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:05:18.579859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0bcfa-73f9-4c24-85f3-dd82d9960e8c None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:18.580146 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0bcfa-73f9-4c24-85f3-dd82d9960e8c None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:18.580425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0bcfa-73f9-4c24-85f3-dd82d9960e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:18.607745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-86a0bcfa-73f9-4c24-85f3-dd82d9960e8c None None] MFA Rules not processed for user `530a3123af2b4255b861e72eeb1a0179`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:18.608888 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-86a0bcfa-73f9-4c24-85f3-dd82d9960e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:18.678913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1392/2807] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:18.689994 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b980fa0-f726-4943-b21e-b3baba563a40 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:18.691697 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0b980fa0-f726-4943-b21e-b3baba563a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:18.748158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b980fa0-f726-4943-b21e-b3baba563a40 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:18.751941 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa7b3c-7747-4435-a306-00ca9c68855f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:18.752604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa7b3c-7747-4435-a306-00ca9c68855f service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:18.752909 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa7b3c-7747-4435-a306-00ca9c68855f service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:18.753192 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa7b3c-7747-4435-a306-00ca9c68855f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:18.763173 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa7b3c-7747-4435-a306-00ca9c68855f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:18.764644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa7b3c-7747-4435-a306-00ca9c68855f service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:18.774445 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1416/2808] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:05:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:05:19.158758 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0bcfa-73f9-4c24-85f3-dd82d9960e8c None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:19.224343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0bcfa-73f9-4c24-85f3-dd82d9960e8c None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:19.229866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:19.230838 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:19.231239 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:19.231551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] PATH_INFO: `/v3/users/460de69fa53d4203867aa367ffcf8e3f` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:19.232952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460de69fa53d4203867aa367ffcf8e3f)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:19.235324 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:19.288219 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460de69fa53d4203867aa367ffcf8e3f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:19.288941 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460de69fa53d4203867aa367ffcf8e3f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:19.289861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460de69fa53d4203867aa367ffcf8e3f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:19.296863 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460de69fa53d4203867aa367ffcf8e3f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:19.310668 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460de69fa53d4203867aa367ffcf8e3f'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:19.331984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1393/2809] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:05:19 2022] DELETE /identity/v3/users/460de69fa53d4203867aa367ffcf8e3f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:19.332096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e95024-2b17-431e-b9dc-dce411d864a0 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:19.332096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e95024-2b17-431e-b9dc-dce411d864a0 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:19.332096 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e95024-2b17-431e-b9dc-dce411d864a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:19.353495 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-95e95024-2b17-431e-b9dc-dce411d864a0 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:19.354845 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-95e95024-2b17-431e-b9dc-dce411d864a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:19.424737 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1417/2810] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 06 13:05:19.435304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:19.436862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:19.494410 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dae45-0f51-4a34-8725-aac5c16c0f05 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:19.498001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5b2e-224f-4222-b30c-f776fe83d2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:19.498650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5b2e-224f-4222-b30c-f776fe83d2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:19.498934 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5b2e-224f-4222-b30c-f776fe83d2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:19.499206 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f5b2e-224f-4222-b30c-f776fe83d2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:19.508991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f5b2e-224f-4222-b30c-f776fe83d2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:19.510518 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f5b2e-224f-4222-b30c-f776fe83d2e7 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:19.519974 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1394/2811] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:05:19.796666 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e95024-2b17-431e-b9dc-dce411d864a0 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:19.798146 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-95e95024-2b17-431e-b9dc-dce411d864a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:19.810856 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e95024-2b17-431e-b9dc-dce411d864a0 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:19.815512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:19.816378 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:19.816658 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:19.816927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] PATH_INFO: `/v3/projects/96de8723969a4193bb8677238a0235dc` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:19.818138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96de8723969a4193bb8677238a0235dc)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:19.820070 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:19.870186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96de8723969a4193bb8677238a0235dc', 'request_id': 'req-a5b5e11d-6cd8-4167-9c59-624f2e636104'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:19.876158 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96de8723969a4193bb8677238a0235dc', 'request_id': 'req-a5b5e11d-6cd8-4167-9c59-624f2e636104'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:19.885084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96de8723969a4193bb8677238a0235dc', 'request_id': 'req-a5b5e11d-6cd8-4167-9c59-624f2e636104'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:19.895610 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] The token cache is being invalidate because project 96de8723969a4193bb8677238a0235dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:05:19.895988 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:19.897182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:19.898715 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1418/2812] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:05:19 2022] DELETE /identity/v3/projects/96de8723969a4193bb8677238a0235dc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:19.902660 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5b2e-224f-4222-b30c-f776fe83d2e7 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:19.912327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f5b2e-224f-4222-b30c-f776fe83d2e7 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:19.966464 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:19.967327 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:19.967634 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:19.967908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] PATH_INFO: `/v3/users/530a3123af2b4255b861e72eeb1a0179` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:19.969088 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=530a3123af2b4255b861e72eeb1a0179)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:19.971065 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:20.017038 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530a3123af2b4255b861e72eeb1a0179'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:20.017707 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530a3123af2b4255b861e72eeb1a0179'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:20.018296 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530a3123af2b4255b861e72eeb1a0179'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:20.025605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530a3123af2b4255b861e72eeb1a0179'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:20.037081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-4fe29f49-f0c1-4902-becd-fc055c34e6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530a3123af2b4255b861e72eeb1a0179'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:20.050661 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1395/2813] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:05:19 2022] DELETE /identity/v3/users/530a3123af2b4255b861e72eeb1a0179 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:20.327374 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:20.328830 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:20.344532 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5e11d-6cd8-4167-9c59-624f2e636104 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:20.404735 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:20.405730 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:20.406083 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:20.406416 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] PATH_INFO: `/v3/projects/b8bcc97d57714eb3a5b9d11bb3573bf5` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:20.407670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8bcc97d57714eb3a5b9d11bb3573bf5)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:20.409684 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:20.458553 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8bcc97d57714eb3a5b9d11bb3573bf5', 'request_id': 'req-8a952a31-8fa2-44a2-a670-f390684870f6'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:20.465407 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8bcc97d57714eb3a5b9d11bb3573bf5', 'request_id': 'req-8a952a31-8fa2-44a2-a670-f390684870f6'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:20.473024 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8bcc97d57714eb3a5b9d11bb3573bf5', 'request_id': 'req-8a952a31-8fa2-44a2-a670-f390684870f6'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:20.484604 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] The token cache is being invalidate because project b8bcc97d57714eb3a5b9d11bb3573bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:05:20.484943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:20.485656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-8a952a31-8fa2-44a2-a670-f390684870f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:20.487189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1419/2814] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:05:20 2022] DELETE /identity/v3/projects/b8bcc97d57714eb3a5b9d11bb3573bf5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:05:20.493054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612da2-c5b3-4382-a4b5-3c705e2f6e82 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:20.493343 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612da2-c5b3-4382-a4b5-3c705e2f6e82 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:20.493668 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612da2-c5b3-4382-a4b5-3c705e2f6e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:20.511451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-16612da2-c5b3-4382-a4b5-3c705e2f6e82 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:20.512675 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-16612da2-c5b3-4382-a4b5-3c705e2f6e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:20.582757 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1396/2815] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:20.595673 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a7d2-bd70-4b26-b583-c537eaa71ef1 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:20.596041 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a7d2-bd70-4b26-b583-c537eaa71ef1 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:20.596849 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a7d2-bd70-4b26-b583-c537eaa71ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:20.616460 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-a9a0a7d2-bd70-4b26-b583-c537eaa71ef1 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:20.617931 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a9a0a7d2-bd70-4b26-b583-c537eaa71ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:20.626512 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1420/2816] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:20.631052 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16612da2-c5b3-4382-a4b5-3c705e2f6e82 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:20.640980 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16612da2-c5b3-4382-a4b5-3c705e2f6e82 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:20.646285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d606a-ebf9-45d3-ab60-8abdac8da674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:20.647507 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d606a-ebf9-45d3-ab60-8abdac8da674 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:20.648175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d606a-ebf9-45d3-ab60-8abdac8da674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:20.648175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d606a-ebf9-45d3-ab60-8abdac8da674 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:20.648947 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d606a-ebf9-45d3-ab60-8abdac8da674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:05:20.649315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d606a-ebf9-45d3-ab60-8abdac8da674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:20.651054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d606a-ebf9-45d3-ab60-8abdac8da674 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:20.666646 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1397/2817] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:05:20.671581 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0a7d2-bd70-4b26-b583-c537eaa71ef1 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:20.681846 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0a7d2-bd70-4b26-b583-c537eaa71ef1 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:20.687665 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2d4f3-5690-4e8f-bb66-b1c34fd9c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:20.688369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d4f3-5690-4e8f-bb66-b1c34fd9c677 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:20.688654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d4f3-5690-4e8f-bb66-b1c34fd9c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:20.688930 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2d4f3-5690-4e8f-bb66-b1c34fd9c677 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:20.689692 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2d4f3-5690-4e8f-bb66-b1c34fd9c677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:20.691653 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2d4f3-5690-4e8f-bb66-b1c34fd9c677 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:20.722457 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1421/2818] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:05:20 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:20.727604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d606a-ebf9-45d3-ab60-8abdac8da674 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:20.738623 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d606a-ebf9-45d3-ab60-8abdac8da674 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:20.801181 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999b0b7-c5a9-4713-b10a-652499445a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:20.801977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b0b7-c5a9-4713-b10a-652499445a2c admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:20.802189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b0b7-c5a9-4713-b10a-652499445a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:20.802468 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b0b7-c5a9-4713-b10a-652499445a2c admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:20.803919 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999b0b7-c5a9-4713-b10a-652499445a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:20.806001 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999b0b7-c5a9-4713-b10a-652499445a2c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:20.826596 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1398/2819] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:05:20 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:20.830725 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2d4f3-5690-4e8f-bb66-b1c34fd9c677 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:20.841961 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2d4f3-5690-4e8f-bb66-b1c34fd9c677 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:20.846565 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abf35b-1f5a-47aa-8863-7889996c145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:20.847225 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abf35b-1f5a-47aa-8863-7889996c145b admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:20.847507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abf35b-1f5a-47aa-8863-7889996c145b admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:20.847783 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abf35b-1f5a-47aa-8863-7889996c145b admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:20.848506 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abf35b-1f5a-47aa-8863-7889996c145b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:20.850846 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abf35b-1f5a-47aa-8863-7889996c145b admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:20.861421 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1422/2820] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:20.865550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999b0b7-c5a9-4713-b10a-652499445a2c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:20.875565 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999b0b7-c5a9-4713-b10a-652499445a2c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:20.880158 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d21805-6489-4e50-a22a-1a3a91971a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:20.880816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d21805-6489-4e50-a22a-1a3a91971a1a admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:20.881783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d21805-6489-4e50-a22a-1a3a91971a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:20.882248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d21805-6489-4e50-a22a-1a3a91971a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:20.883232 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d21805-6489-4e50-a22a-1a3a91971a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:20.884852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d21805-6489-4e50-a22a-1a3a91971a1a admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:20.895189 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1399/2821] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:20.900186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abf35b-1f5a-47aa-8863-7889996c145b admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:20.910369 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abf35b-1f5a-47aa-8863-7889996c145b admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:20.915784 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd5f8c-6fe9-4b25-870e-a2626f92450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:20.916675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd5f8c-6fe9-4b25-870e-a2626f92450e admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:20.916956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd5f8c-6fe9-4b25-870e-a2626f92450e admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:20.917229 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd5f8c-6fe9-4b25-870e-a2626f92450e admin admin] PATH_INFO: `/v3/projects/ecbfbb551c8a4126b6fa7cb687c2af43/users/5ea245cd3ca142a08d5f3bb2496244d1/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:20.931857 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd5f8c-6fe9-4b25-870e-a2626f92450e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbfbb551c8a4126b6fa7cb687c2af43, user_id=5ea245cd3ca142a08d5f3bb2496244d1, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:20.934544 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd5f8c-6fe9-4b25-870e-a2626f92450e admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:20.948268 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1423/2822] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:05:20 2022] PUT /identity/v3/projects/ecbfbb551c8a4126b6fa7cb687c2af43/users/5ea245cd3ca142a08d5f3bb2496244d1/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:20.960818 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba501-867b-4cfb-a87f-ef346f7c6a07 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:20.961036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba501-867b-4cfb-a87f-ef346f7c6a07 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:20.961310 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba501-867b-4cfb-a87f-ef346f7c6a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:20.987854 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-b6cba501-867b-4cfb-a87f-ef346f7c6a07 None None] MFA Rules not processed for user `5ea245cd3ca142a08d5f3bb2496244d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:20.989474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b6cba501-867b-4cfb-a87f-ef346f7c6a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:21.053063 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1400/2823] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:21.057299 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd5f8c-6fe9-4b25-870e-a2626f92450e admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:21.117087 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd5f8c-6fe9-4b25-870e-a2626f92450e admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:21.121702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eff38-feea-40ff-b49c-6a17710b4383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:21.122354 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eff38-feea-40ff-b49c-6a17710b4383 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:21.122636 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eff38-feea-40ff-b49c-6a17710b4383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:21.122910 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eff38-feea-40ff-b49c-6a17710b4383 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:21.123610 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58eff38-feea-40ff-b49c-6a17710b4383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:21.125498 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58eff38-feea-40ff-b49c-6a17710b4383 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:21.151758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1424/2824] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:05:21 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:21.156085 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cba501-867b-4cfb-a87f-ef346f7c6a07 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:21.167627 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cba501-867b-4cfb-a87f-ef346f7c6a07 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:21.223144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6f58e-bda3-4315-b3d3-e375009ef2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:21.223724 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f58e-bda3-4315-b3d3-e375009ef2ac admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:21.224005 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f58e-bda3-4315-b3d3-e375009ef2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:21.224281 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6f58e-bda3-4315-b3d3-e375009ef2ac admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:21.225306 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6f58e-bda3-4315-b3d3-e375009ef2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:21.227124 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6f58e-bda3-4315-b3d3-e375009ef2ac admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:21.247790 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1401/2825] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:05:21 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 06 13:05:21.251863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eff38-feea-40ff-b49c-6a17710b4383 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:21.262956 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58eff38-feea-40ff-b49c-6a17710b4383 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:21.267631 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8a169-8a2e-4eea-b0d4-fd0e99a2df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:21.268295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8a169-8a2e-4eea-b0d4-fd0e99a2df13 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:21.268583 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8a169-8a2e-4eea-b0d4-fd0e99a2df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:21.268863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8a169-8a2e-4eea-b0d4-fd0e99a2df13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:21.269601 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8a169-8a2e-4eea-b0d4-fd0e99a2df13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:21.271249 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8a169-8a2e-4eea-b0d4-fd0e99a2df13 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:21.281816 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1425/2826] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:21.286203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6f58e-bda3-4315-b3d3-e375009ef2ac admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:21.296810 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6f58e-bda3-4315-b3d3-e375009ef2ac admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:21.301507 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d146f7-e5a7-4285-b067-5f8e14ec644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:21.302474 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d146f7-e5a7-4285-b067-5f8e14ec644e admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:21.303285 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d146f7-e5a7-4285-b067-5f8e14ec644e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:21.304025 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d146f7-e5a7-4285-b067-5f8e14ec644e admin admin] PATH_INFO: `/v3/projects/2c965e0527514b258087c91e9094d2a9/users/262a65b5bb8b481181ed2b9e29a9df03/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:21.319642 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d146f7-e5a7-4285-b067-5f8e14ec644e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c965e0527514b258087c91e9094d2a9, user_id=262a65b5bb8b481181ed2b9e29a9df03, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:21.322377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d146f7-e5a7-4285-b067-5f8e14ec644e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:21.336282 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1402/2827] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:05:21 2022] PUT /identity/v3/projects/2c965e0527514b258087c91e9094d2a9/users/262a65b5bb8b481181ed2b9e29a9df03/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:21.340232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8a169-8a2e-4eea-b0d4-fd0e99a2df13 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:21.350352 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8a169-8a2e-4eea-b0d4-fd0e99a2df13 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:21.406504 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a967d97-6992-4264-b3a5-2a39c4fbdd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:21.407183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a967d97-6992-4264-b3a5-2a39c4fbdd2a admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:21.407471 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a967d97-6992-4264-b3a5-2a39c4fbdd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:21.407751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a967d97-6992-4264-b3a5-2a39c4fbdd2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:21.408478 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a967d97-6992-4264-b3a5-2a39c4fbdd2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:21.410150 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a967d97-6992-4264-b3a5-2a39c4fbdd2a admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:21.420292 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1426/2828] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:21.424679 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d146f7-e5a7-4285-b067-5f8e14ec644e admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:21.435437 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d146f7-e5a7-4285-b067-5f8e14ec644e admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:21.440133 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09bd97-8664-4f85-bbd5-41f7f30af759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:21.441023 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09bd97-8664-4f85-bbd5-41f7f30af759 admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:21.441299 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09bd97-8664-4f85-bbd5-41f7f30af759 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:21.441604 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09bd97-8664-4f85-bbd5-41f7f30af759 admin admin] PATH_INFO: `/v3/projects/2c965e0527514b258087c91e9094d2a9/users/262a65b5bb8b481181ed2b9e29a9df03/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:21.443593 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09bd97-8664-4f85-bbd5-41f7f30af759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c965e0527514b258087c91e9094d2a9, user_id=262a65b5bb8b481181ed2b9e29a9df03, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:21.446309 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09bd97-8664-4f85-bbd5-41f7f30af759 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:21.456723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1403/2829] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:05:21 2022] PUT /identity/v3/projects/2c965e0527514b258087c91e9094d2a9/users/262a65b5bb8b481181ed2b9e29a9df03/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:21.467321 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b1687-535d-414b-a6f1-2eb0d05136a2 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:21.467606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b1687-535d-414b-a6f1-2eb0d05136a2 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:21.467884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b1687-535d-414b-a6f1-2eb0d05136a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:21.494539 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-b45b1687-535d-414b-a6f1-2eb0d05136a2 None None] MFA Rules not processed for user `262a65b5bb8b481181ed2b9e29a9df03`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:21.495976 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b45b1687-535d-414b-a6f1-2eb0d05136a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:21.568912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1427/2830] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:21.580372 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09bd97-8664-4f85-bbd5-41f7f30af759 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:21.582130 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-5a09bd97-8664-4f85-bbd5-41f7f30af759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:21.644966 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09bd97-8664-4f85-bbd5-41f7f30af759 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:21.650300 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439d6a7-04a0-4961-a4dd-aab1764a0d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:21.650956 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d6a7-04a0-4961-a4dd-aab1764a0d87 service cinder] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:21.651239 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d6a7-04a0-4961-a4dd-aab1764a0d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:21.651517 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439d6a7-04a0-4961-a4dd-aab1764a0d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:21.661051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439d6a7-04a0-4961-a4dd-aab1764a0d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:21.663207 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439d6a7-04a0-4961-a4dd-aab1764a0d87 service cinder] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:21.673348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1404/2831] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:05:21 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:05:21.760991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b1687-535d-414b-a6f1-2eb0d05136a2 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:21.771132 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b1687-535d-414b-a6f1-2eb0d05136a2 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:21.777610 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eecca0-1f7e-45a3-a522-8fd7e793e4f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7277fd0f4cf64df4aaa65d7743b99028', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:21.778536 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eecca0-1f7e-45a3-a522-8fd7e793e4f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:21.778958 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eecca0-1f7e-45a3-a522-8fd7e793e4f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:21.779312 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eecca0-1f7e-45a3-a522-8fd7e793e4f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:21.860254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eecca0-1f7e-45a3-a522-8fd7e793e4f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:21.861793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eecca0-1f7e-45a3-a522-8fd7e793e4f7 service cinder] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:21.873780 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1428/2832] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:05:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:05:26.754062 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439d6a7-04a0-4961-a4dd-aab1764a0d87 service cinder] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:26.813144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439d6a7-04a0-4961-a4dd-aab1764a0d87 service cinder] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:26.817542 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:26.819050 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:26.819329 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:26.819605 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] PATH_INFO: `/v3/users/5ea245cd3ca142a08d5f3bb2496244d1` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:26.820913 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea245cd3ca142a08d5f3bb2496244d1)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:26.822879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:26.870887 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea245cd3ca142a08d5f3bb2496244d1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:26.871585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea245cd3ca142a08d5f3bb2496244d1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:26.872185 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea245cd3ca142a08d5f3bb2496244d1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:26.879730 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea245cd3ca142a08d5f3bb2496244d1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:26.891606 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea245cd3ca142a08d5f3bb2496244d1'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:26.905036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1405/2833] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:05:26 2022] DELETE /identity/v3/users/5ea245cd3ca142a08d5f3bb2496244d1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:26.909557 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534cc2-ae15-4c21-a130-5922b2b6fe6d None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:26.910168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534cc2-ae15-4c21-a130-5922b2b6fe6d None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:26.910168 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534cc2-ae15-4c21-a130-5922b2b6fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:26.927771 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-00534cc2-ae15-4c21-a130-5922b2b6fe6d None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:26.929912 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-00534cc2-ae15-4c21-a130-5922b2b6fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:26.993093 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1429/2834] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:27.002968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:27.004408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:27.061251 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da92001-4b28-4b18-8b8e-1d4661fd2dcd admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:27.064968 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c45237-08b8-4860-b15f-7f5db5205469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:27.065637 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45237-08b8-4860-b15f-7f5db5205469 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:27.065926 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45237-08b8-4860-b15f-7f5db5205469 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:27.066208 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45237-08b8-4860-b15f-7f5db5205469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:27.076107 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c45237-08b8-4860-b15f-7f5db5205469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:27.077587 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c45237-08b8-4860-b15f-7f5db5205469 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:27.087798 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1406/2835] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:05:27.359732 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00534cc2-ae15-4c21-a130-5922b2b6fe6d None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:27.361183 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-00534cc2-ae15-4c21-a130-5922b2b6fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:27.373541 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00534cc2-ae15-4c21-a130-5922b2b6fe6d None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:27.381472 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:27.382987 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:27.383475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:27.383991 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] PATH_INFO: `/v3/projects/ecbfbb551c8a4126b6fa7cb687c2af43` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:27.386032 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbfbb551c8a4126b6fa7cb687c2af43)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:27.388295 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:27.438738 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbfbb551c8a4126b6fa7cb687c2af43', 'request_id': 'req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:27.445943 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbfbb551c8a4126b6fa7cb687c2af43', 'request_id': 'req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:27.454351 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbfbb551c8a4126b6fa7cb687c2af43', 'request_id': 'req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:27.465135 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] The token cache is being invalidate because project ecbfbb551c8a4126b6fa7cb687c2af43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:05:27.465425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:27.466151 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:27.467702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1430/2836] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:05:27 2022] DELETE /identity/v3/projects/ecbfbb551c8a4126b6fa7cb687c2af43 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:27.471671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c45237-08b8-4860-b15f-7f5db5205469 service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:27.481638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c45237-08b8-4860-b15f-7f5db5205469 service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:27.538282 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:27.539184 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:27.539751 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:27.539984 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] PATH_INFO: `/v3/users/262a65b5bb8b481181ed2b9e29a9df03` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:27.541199 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=262a65b5bb8b481181ed2b9e29a9df03)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:27.543177 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:27.590836 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262a65b5bb8b481181ed2b9e29a9df03'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:27.591485 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262a65b5bb8b481181ed2b9e29a9df03'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:27.592078 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262a65b5bb8b481181ed2b9e29a9df03'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:27.599136 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262a65b5bb8b481181ed2b9e29a9df03'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:27.611788 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-da61bec5-e0bc-4dd1-b445-525a4688b7f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262a65b5bb8b481181ed2b9e29a9df03'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:27.625991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1407/2837] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:05:27 2022] DELETE /identity/v3/users/262a65b5bb8b481181ed2b9e29a9df03 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:27.919705 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:27.921280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:27.936915 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15e7c9-06ab-4e10-99fe-313a9fe6b5e4 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:27.997245 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:27.998175 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:27.998455 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:27.998766 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] PATH_INFO: `/v3/projects/2c965e0527514b258087c91e9094d2a9` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.000101 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c965e0527514b258087c91e9094d2a9)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:28.002259 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:28.049162 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c965e0527514b258087c91e9094d2a9', 'request_id': 'req-34462823-bfec-4836-859e-2447d0ce95a5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:28.055793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c965e0527514b258087c91e9094d2a9', 'request_id': 'req-34462823-bfec-4836-859e-2447d0ce95a5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:28.063439 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c965e0527514b258087c91e9094d2a9', 'request_id': 'req-34462823-bfec-4836-859e-2447d0ce95a5'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:28.073927 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] The token cache is being invalidate because project 2c965e0527514b258087c91e9094d2a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:05:28.074210 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:28.074833 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-34462823-bfec-4836-859e-2447d0ce95a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:28.076376 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1431/2838] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:05:27 2022] DELETE /identity/v3/projects/2c965e0527514b258087c91e9094d2a9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:28.081213 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8d765-f957-4a84-826d-b14741afd631 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:28.081699 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8d765-f957-4a84-826d-b14741afd631 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:28.081794 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8d765-f957-4a84-826d-b14741afd631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.100432 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-36c8d765-f957-4a84-826d-b14741afd631 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:28.101693 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-36c8d765-f957-4a84-826d-b14741afd631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:28.161860 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1408/2839] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:28.170804 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658146de-fc6b-48f6-9850-c13441ab6b85 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:28.171088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658146de-fc6b-48f6-9850-c13441ab6b85 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:28.171359 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658146de-fc6b-48f6-9850-c13441ab6b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.189635 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-658146de-fc6b-48f6-9850-c13441ab6b85 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:28.190831 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-658146de-fc6b-48f6-9850-c13441ab6b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:28.198695 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1432/2840] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:28.203761 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8d765-f957-4a84-826d-b14741afd631 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:28.216036 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8d765-f957-4a84-826d-b14741afd631 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:28.220821 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f2f29-1271-4a56-89b8-e0f14b7925fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:28.221509 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f2f29-1271-4a56-89b8-e0f14b7925fd admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:28.221850 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f2f29-1271-4a56-89b8-e0f14b7925fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:28.222128 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f2f29-1271-4a56-89b8-e0f14b7925fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.222866 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f2f29-1271-4a56-89b8-e0f14b7925fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:05:28.223173 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f2f29-1271-4a56-89b8-e0f14b7925fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:28.225370 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f2f29-1271-4a56-89b8-e0f14b7925fd admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:28.237011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1409/2841] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:05:28.242839 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658146de-fc6b-48f6-9850-c13441ab6b85 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:28.254247 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658146de-fc6b-48f6-9850-c13441ab6b85 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:28.260062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27983a38-566d-4d4d-9c08-7f2dcf6dc407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:28.260719 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27983a38-566d-4d4d-9c08-7f2dcf6dc407 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:28.261006 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27983a38-566d-4d4d-9c08-7f2dcf6dc407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:28.261280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27983a38-566d-4d4d-9c08-7f2dcf6dc407 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.262028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27983a38-566d-4d4d-9c08-7f2dcf6dc407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:28.263937 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27983a38-566d-4d4d-9c08-7f2dcf6dc407 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:28.292573 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1433/2842] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:05:28 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:28.296775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f2f29-1271-4a56-89b8-e0f14b7925fd admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:28.306713 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f2f29-1271-4a56-89b8-e0f14b7925fd admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:28.361942 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028daab-f751-4d5b-a768-976a4c72d6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:28.362614 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028daab-f751-4d5b-a768-976a4c72d6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:28.362899 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028daab-f751-4d5b-a768-976a4c72d6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:28.363178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028daab-f751-4d5b-a768-976a4c72d6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.363879 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028daab-f751-4d5b-a768-976a4c72d6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:28.366255 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028daab-f751-4d5b-a768-976a4c72d6d8 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:28.387663 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1410/2843] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:05:28 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:28.391706 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27983a38-566d-4d4d-9c08-7f2dcf6dc407 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:28.402787 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27983a38-566d-4d4d-9c08-7f2dcf6dc407 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:28.407562 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c0ab6-1e81-43cc-9efd-5b2a2634b19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:28.408212 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c0ab6-1e81-43cc-9efd-5b2a2634b19f admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:28.408494 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c0ab6-1e81-43cc-9efd-5b2a2634b19f admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:28.408768 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c0ab6-1e81-43cc-9efd-5b2a2634b19f admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.409497 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c0ab6-1e81-43cc-9efd-5b2a2634b19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:28.411118 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c0ab6-1e81-43cc-9efd-5b2a2634b19f admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:28.422375 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1434/2844] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:28.426351 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028daab-f751-4d5b-a768-976a4c72d6d8 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:28.436420 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028daab-f751-4d5b-a768-976a4c72d6d8 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:28.441145 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea7547-dfcc-4f84-9cc3-dc9c4e31b01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:28.441819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea7547-dfcc-4f84-9cc3-dc9c4e31b01e admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:28.442140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea7547-dfcc-4f84-9cc3-dc9c4e31b01e admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:28.442408 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea7547-dfcc-4f84-9cc3-dc9c4e31b01e admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.443138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea7547-dfcc-4f84-9cc3-dc9c4e31b01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:28.445271 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea7547-dfcc-4f84-9cc3-dc9c4e31b01e admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:28.455275 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1411/2845] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:28.459919 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c0ab6-1e81-43cc-9efd-5b2a2634b19f admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:28.469999 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c0ab6-1e81-43cc-9efd-5b2a2634b19f admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:28.474620 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca8c69-e45c-4897-b85b-454bd1189b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:28.475653 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca8c69-e45c-4897-b85b-454bd1189b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:28.475935 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca8c69-e45c-4897-b85b-454bd1189b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:28.476206 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca8c69-e45c-4897-b85b-454bd1189b04 admin admin] PATH_INFO: `/v3/projects/3b8b2197faa8425f8ee78d72864805cf/users/e269b8579b304b9cb47300c9c4cf9f95/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.490757 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca8c69-e45c-4897-b85b-454bd1189b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8b2197faa8425f8ee78d72864805cf, user_id=e269b8579b304b9cb47300c9c4cf9f95, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:28.493461 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca8c69-e45c-4897-b85b-454bd1189b04 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:28.508349 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1435/2846] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:05:28 2022] PUT /identity/v3/projects/3b8b2197faa8425f8ee78d72864805cf/users/e269b8579b304b9cb47300c9c4cf9f95/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:28.519697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5dd8d-32cc-42c1-aa91-7a4904f39f4d None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:28.519990 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5dd8d-32cc-42c1-aa91-7a4904f39f4d None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:28.520273 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5dd8d-32cc-42c1-aa91-7a4904f39f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.548480 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-d6f5dd8d-32cc-42c1-aa91-7a4904f39f4d None None] MFA Rules not processed for user `e269b8579b304b9cb47300c9c4cf9f95`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:28.549727 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d6f5dd8d-32cc-42c1-aa91-7a4904f39f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:28.614522 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1412/2847] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:28.626793 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca8c69-e45c-4897-b85b-454bd1189b04 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:28.628507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b6ca8c69-e45c-4897-b85b-454bd1189b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:28.687028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca8c69-e45c-4897-b85b-454bd1189b04 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:28.690743 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaf214-c6b6-4fd2-ba45-81ae0b84ee49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7330a81c0f3a496ea29ae911fcc69221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:28.691392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaf214-c6b6-4fd2-ba45-81ae0b84ee49 service glance] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:28.691675 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaf214-c6b6-4fd2-ba45-81ae0b84ee49 service glance] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:28.691952 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaf214-c6b6-4fd2-ba45-81ae0b84ee49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:28.701392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbaf214-c6b6-4fd2-ba45-81ae0b84ee49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:28.702882 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbaf214-c6b6-4fd2-ba45-81ae0b84ee49 service glance] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:28.712232 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1436/2848] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:05:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:05:36.169599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5dd8d-32cc-42c1-aa91-7a4904f39f4d None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:36.171356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-d6f5dd8d-32cc-42c1-aa91-7a4904f39f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:36.253140 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5dd8d-32cc-42c1-aa91-7a4904f39f4d None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:36.258301 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:36.259178 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:36.259459 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:36.259732 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] PATH_INFO: `/v3/users/d707cd92b1684906a57b22b834417fdf` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:36.260924 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d707cd92b1684906a57b22b834417fdf)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:36.262917 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:36.317946 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd707cd92b1684906a57b22b834417fdf'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:36.318705 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd707cd92b1684906a57b22b834417fdf'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:36.319398 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd707cd92b1684906a57b22b834417fdf'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:36.326550 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd707cd92b1684906a57b22b834417fdf'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:36.339950 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd707cd92b1684906a57b22b834417fdf'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:36.355309 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1413/2849] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:05:36 2022] DELETE /identity/v3/users/d707cd92b1684906a57b22b834417fdf => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:36.532751 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaf214-c6b6-4fd2-ba45-81ae0b84ee49 service glance] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:36.544459 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaf214-c6b6-4fd2-ba45-81ae0b84ee49 service glance] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:36.608064 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:36.608947 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:36.609226 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:36.609501 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] PATH_INFO: `/v3/projects/0c8bc3b24e6340d68f7e16a3cffea4a4` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:36.610769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8bc3b24e6340d68f7e16a3cffea4a4)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:36.612683 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:36.659404 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8bc3b24e6340d68f7e16a3cffea4a4', 'request_id': 'req-ccefbdfe-3250-4c84-b714-4c7e8d15f267'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:36.666739 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8bc3b24e6340d68f7e16a3cffea4a4', 'request_id': 'req-ccefbdfe-3250-4c84-b714-4c7e8d15f267'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:36.675486 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8bc3b24e6340d68f7e16a3cffea4a4', 'request_id': 'req-ccefbdfe-3250-4c84-b714-4c7e8d15f267'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:36.687914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] The token cache is being invalidate because project 0c8bc3b24e6340d68f7e16a3cffea4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:05:36.688253 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:36.688883 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-ccefbdfe-3250-4c84-b714-4c7e8d15f267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:36.690477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1437/2850] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:05:36 2022] DELETE /identity/v3/projects/0c8bc3b24e6340d68f7e16a3cffea4a4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:58.939702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:58.941296 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:58.954210 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abe095-a8f4-49c2-abcf-05451a649842 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:59.011764 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:59.012540 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:59.012820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:59.013096 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] PATH_INFO: `/v3/users/e269b8579b304b9cb47300c9c4cf9f95` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:59.014315 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e269b8579b304b9cb47300c9c4cf9f95)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:59.016248 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:59.061551 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e269b8579b304b9cb47300c9c4cf9f95'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:59.062226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e269b8579b304b9cb47300c9c4cf9f95'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:59.062819 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e269b8579b304b9cb47300c9c4cf9f95'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:59.069861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e269b8579b304b9cb47300c9c4cf9f95'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:59.081655 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e269b8579b304b9cb47300c9c4cf9f95'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:59.094697 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1414/2851] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:05:58 2022] DELETE /identity/v3/users/e269b8579b304b9cb47300c9c4cf9f95 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:59.099277 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32452be5-a9f3-436c-bfd4-2d8f05ef7eb8 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:59.099777 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32452be5-a9f3-436c-bfd4-2d8f05ef7eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:59.099887 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32452be5-a9f3-436c-bfd4-2d8f05ef7eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:59.117762 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-32452be5-a9f3-436c-bfd4-2d8f05ef7eb8 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:59.118964 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-32452be5-a9f3-436c-bfd4-2d8f05ef7eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:59.177475 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1438/2852] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:59.188061 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:59.189463 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:59.252331 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b49b7-04f5-4d55-b7b9-d84c57073797 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:59.256094 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc075d1-a00a-40c6-bbc1-6bb5524f18b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:59.256745 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc075d1-a00a-40c6-bbc1-6bb5524f18b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:59.257539 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc075d1-a00a-40c6-bbc1-6bb5524f18b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:59.258402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc075d1-a00a-40c6-bbc1-6bb5524f18b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:59.267657 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc075d1-a00a-40c6-bbc1-6bb5524f18b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:59.269119 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc075d1-a00a-40c6-bbc1-6bb5524f18b5 service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:59.279461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1415/2853] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:05:59.542131 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32452be5-a9f3-436c-bfd4-2d8f05ef7eb8 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:59.543647 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-32452be5-a9f3-436c-bfd4-2d8f05ef7eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:59.555758 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32452be5-a9f3-436c-bfd4-2d8f05ef7eb8 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:59.562499 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:59.563419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:59.564368 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:59.564686 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] PATH_INFO: `/v3/projects/3b8b2197faa8425f8ee78d72864805cf` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:59.566097 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8b2197faa8425f8ee78d72864805cf)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:59.568028 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:59.620900 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8b2197faa8425f8ee78d72864805cf', 'request_id': 'req-9a6bb9f1-7360-45e6-b96d-c0541f323916'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:59.627195 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8b2197faa8425f8ee78d72864805cf', 'request_id': 'req-9a6bb9f1-7360-45e6-b96d-c0541f323916'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:59.635808 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8b2197faa8425f8ee78d72864805cf', 'request_id': 'req-9a6bb9f1-7360-45e6-b96d-c0541f323916'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:59.646263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] The token cache is being invalidate because project 3b8b2197faa8425f8ee78d72864805cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:05:59.646548 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:59.647189 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-9a6bb9f1-7360-45e6-b96d-c0541f323916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:05:59.648975 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1439/2854] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:05:59 2022] DELETE /identity/v3/projects/3b8b2197faa8425f8ee78d72864805cf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:05:59.654890 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaaf4e-7fb2-4ff5-9efa-0bb3b6bbd666 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:59.655187 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaaf4e-7fb2-4ff5-9efa-0bb3b6bbd666 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:59.655467 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaaaf4e-7fb2-4ff5-9efa-0bb3b6bbd666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:59.672815 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-2eaaaf4e-7fb2-4ff5-9efa-0bb3b6bbd666 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:59.674054 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2eaaaf4e-7fb2-4ff5-9efa-0bb3b6bbd666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:59.731754 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1416/2855] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:59.739570 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf5a8c-d0a2-4e0e-be52-85d641804db5 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:59.739847 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf5a8c-d0a2-4e0e-be52-85d641804db5 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:59.740117 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf5a8c-d0a2-4e0e-be52-85d641804db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:59.759084 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-5bdf5a8c-d0a2-4e0e-be52-85d641804db5 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:05:59.760263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5bdf5a8c-d0a2-4e0e-be52-85d641804db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:05:59.768040 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1440/2856] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:05:59.772304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaaaf4e-7fb2-4ff5-9efa-0bb3b6bbd666 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:59.781846 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaaaf4e-7fb2-4ff5-9efa-0bb3b6bbd666 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:59.786396 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac8394-ad8c-4144-9d47-ff61706c6c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:59.786980 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac8394-ad8c-4144-9d47-ff61706c6c14 admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:59.787259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac8394-ad8c-4144-9d47-ff61706c6c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:59.787534 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac8394-ad8c-4144-9d47-ff61706c6c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:59.788289 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac8394-ad8c-4144-9d47-ff61706c6c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 06 13:05:59.788618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac8394-ad8c-4144-9d47-ff61706c6c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:59.790650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac8394-ad8c-4144-9d47-ff61706c6c14 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:59.801732 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1417/2857] 10.222.0.23 () {58 vars in 1152 bytes} [Wed Apr 6 13:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 06 13:05:59.806906 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf5a8c-d0a2-4e0e-be52-85d641804db5 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:59.816747 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf5a8c-d0a2-4e0e-be52-85d641804db5 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:59.822656 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323c9db-584d-436b-9eac-9776b78eb278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:59.823332 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323c9db-584d-436b-9eac-9776b78eb278 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:59.823621 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323c9db-584d-436b-9eac-9776b78eb278 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:59.823897 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323c9db-584d-436b-9eac-9776b78eb278 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:59.824584 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323c9db-584d-436b-9eac-9776b78eb278 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:59.826523 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323c9db-584d-436b-9eac-9776b78eb278 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:59.859106 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1441/2858] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:05:59 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:59.863202 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac8394-ad8c-4144-9d47-ff61706c6c14 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:59.873873 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac8394-ad8c-4144-9d47-ff61706c6c14 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:59.932735 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4e82c-e1ab-4640-b3c0-c43d500ea50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:59.933402 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4e82c-e1ab-4640-b3c0-c43d500ea50b admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:59.933720 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4e82c-e1ab-4640-b3c0-c43d500ea50b admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:59.934003 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4e82c-e1ab-4640-b3c0-c43d500ea50b admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:59.934692 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4e82c-e1ab-4640-b3c0-c43d500ea50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:59.936684 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4e82c-e1ab-4640-b3c0-c43d500ea50b admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:59.958991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1418/2859] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:05:59 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:05:59.963276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323c9db-584d-436b-9eac-9776b78eb278 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:05:59.973188 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323c9db-584d-436b-9eac-9776b78eb278 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:05:59.978654 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7efa0-b169-48a1-9e4b-415eb4c1d3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:05:59.979017 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7efa0-b169-48a1-9e4b-415eb4c1d3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:05:59.979294 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7efa0-b169-48a1-9e4b-415eb4c1d3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:05:59.979561 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7efa0-b169-48a1-9e4b-415eb4c1d3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:05:59.980276 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7efa0-b169-48a1-9e4b-415eb4c1d3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:05:59.982337 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7efa0-b169-48a1-9e4b-415eb4c1d3a3 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:05:59.993480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1442/2860] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:05:59.997633 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4e82c-e1ab-4640-b3c0-c43d500ea50b admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:00.008472 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4e82c-e1ab-4640-b3c0-c43d500ea50b admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:00.013508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946f38b-b760-4f91-aef9-19e302c3d2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:00.014214 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f38b-b760-4f91-aef9-19e302c3d2eb admin admin] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:00.014499 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f38b-b760-4f91-aef9-19e302c3d2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:00.014775 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946f38b-b760-4f91-aef9-19e302c3d2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:00.015502 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946f38b-b760-4f91-aef9-19e302c3d2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:00.017180 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946f38b-b760-4f91-aef9-19e302c3d2eb admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:00.028134 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1419/2861] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:06:00.032280 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7efa0-b169-48a1-9e4b-415eb4c1d3a3 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:00.043068 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7efa0-b169-48a1-9e4b-415eb4c1d3a3 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:00.047552 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e29b2-164e-4c64-b131-f19b02d929fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:00.048412 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e29b2-164e-4c64-b131-f19b02d929fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:00.048685 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e29b2-164e-4c64-b131-f19b02d929fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:00.048949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e29b2-164e-4c64-b131-f19b02d929fc admin admin] PATH_INFO: `/v3/projects/892bf9a242a641b3a5354852056c1dac/users/1b4c270df37645698b3f92dd2714d2fe/roles/9b6d2d07e37f449699fd25de81ee509a` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:00.063479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e29b2-164e-4c64-b131-f19b02d929fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=892bf9a242a641b3a5354852056c1dac, user_id=1b4c270df37645698b3f92dd2714d2fe, role_id=9b6d2d07e37f449699fd25de81ee509a)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:00.066153 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e29b2-164e-4c64-b131-f19b02d929fc admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:00.079076 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1443/2862] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:06:00 2022] PUT /identity/v3/projects/892bf9a242a641b3a5354852056c1dac/users/1b4c270df37645698b3f92dd2714d2fe/roles/9b6d2d07e37f449699fd25de81ee509a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:06:00.084159 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814b34-47cb-45b5-abe8-2a4779c905c2 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:00.084451 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814b34-47cb-45b5-abe8-2a4779c905c2 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:00.084731 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3814b34-47cb-45b5-abe8-2a4779c905c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:00.102670 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-c3814b34-47cb-45b5-abe8-2a4779c905c2 None None] MFA Rules not processed for user `3e20a973b647478db16f26c4e132ad3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:06:00.103862 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-c3814b34-47cb-45b5-abe8-2a4779c905c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:00.159544 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1420/2863] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:06:00.169806 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e29b2-164e-4c64-b131-f19b02d929fc admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:00.171480 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-570e29b2-164e-4c64-b131-f19b02d929fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:00.225470 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e29b2-164e-4c64-b131-f19b02d929fc admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:00.229818 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e3fa4-4771-42ee-a2db-f5aac5c79989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:00.230462 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e3fa4-4771-42ee-a2db-f5aac5c79989 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:00.230740 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e3fa4-4771-42ee-a2db-f5aac5c79989 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:00.231008 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e3fa4-4771-42ee-a2db-f5aac5c79989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:00.240008 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e3fa4-4771-42ee-a2db-f5aac5c79989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:00.241505 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e3fa4-4771-42ee-a2db-f5aac5c79989 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:00.250924 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1444/2864] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:06:04.256422 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00a929-97dc-40ff-ad4f-889869d4bfcc None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:04.257114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00a929-97dc-40ff-ad4f-889869d4bfcc None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:04.257114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00a929-97dc-40ff-ad4f-889869d4bfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:04.286455 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-bc00a929-97dc-40ff-ad4f-889869d4bfcc None None] MFA Rules not processed for user `1b4c270df37645698b3f92dd2714d2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:06:04.287618 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-bc00a929-97dc-40ff-ad4f-889869d4bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:04.363374 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1421/2865] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:06:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:06:04.369174 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e3fa4-4771-42ee-a2db-f5aac5c79989 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:04.379333 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e3fa4-4771-42ee-a2db-f5aac5c79989 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:04.385632 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501229f-f670-4b9e-bc4f-90a99cc019b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:04.386336 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501229f-f670-4b9e-bc4f-90a99cc019b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:04.386612 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501229f-f670-4b9e-bc4f-90a99cc019b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:04.386884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501229f-f670-4b9e-bc4f-90a99cc019b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:04.387579 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501229f-f670-4b9e-bc4f-90a99cc019b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:04.389492 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501229f-f670-4b9e-bc4f-90a99cc019b0 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:04.417077 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1445/2866] 10.222.0.23 () {60 vars in 1152 bytes} [Wed Apr 6 13:06:04 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:06:04.421314 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00a929-97dc-40ff-ad4f-889869d4bfcc None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:04.434260 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00a929-97dc-40ff-ad4f-889869d4bfcc None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:04.498168 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93395050-e604-4332-9a41-5ca906b092fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:04.498883 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93395050-e604-4332-9a41-5ca906b092fe admin admin] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:04.499165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93395050-e604-4332-9a41-5ca906b092fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:04.499438 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93395050-e604-4332-9a41-5ca906b092fe admin admin] PATH_INFO: `/v3/users` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:04.500295 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93395050-e604-4332-9a41-5ca906b092fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:04.502365 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93395050-e604-4332-9a41-5ca906b092fe admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:04.525144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1422/2867] 10.222.0.23 () {60 vars in 1143 bytes} [Wed Apr 6 13:06:04 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 06 13:06:04.529474 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501229f-f670-4b9e-bc4f-90a99cc019b0 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:04.563256 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501229f-f670-4b9e-bc4f-90a99cc019b0 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:04.568254 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be51c7-2d6d-407b-a0f3-603d6015d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:04.568925 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be51c7-2d6d-407b-a0f3-603d6015d728 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:04.569209 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be51c7-2d6d-407b-a0f3-603d6015d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:04.569769 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be51c7-2d6d-407b-a0f3-603d6015d728 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:04.570989 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be51c7-2d6d-407b-a0f3-603d6015d728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:04.572579 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be51c7-2d6d-407b-a0f3-603d6015d728 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:04.583479 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1446/2868] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 06 13:06:04.588144 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93395050-e604-4332-9a41-5ca906b092fe admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:04.602744 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93395050-e604-4332-9a41-5ca906b092fe admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:04.607861 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee874bbb-bd30-43ad-8a2c-5abbe38f4efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:04.608835 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee874bbb-bd30-43ad-8a2c-5abbe38f4efb admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:04.609203 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee874bbb-bd30-43ad-8a2c-5abbe38f4efb admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:04.609548 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee874bbb-bd30-43ad-8a2c-5abbe38f4efb admin admin] PATH_INFO: `/v3/projects/93b44ec61bc148d9a4caa03337f9353e/users/6522847633d84445ac66edb4be6124d8/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:04.627628 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee874bbb-bd30-43ad-8a2c-5abbe38f4efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b44ec61bc148d9a4caa03337f9353e, user_id=6522847633d84445ac66edb4be6124d8, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:04.630348 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee874bbb-bd30-43ad-8a2c-5abbe38f4efb admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:04.644428 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1423/2869] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:06:04 2022] PUT /identity/v3/projects/93b44ec61bc148d9a4caa03337f9353e/users/6522847633d84445ac66edb4be6124d8/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:06:04.648600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be51c7-2d6d-407b-a0f3-603d6015d728 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:04.659044 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be51c7-2d6d-407b-a0f3-603d6015d728 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:04.721918 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65ac3-cd3c-4658-8ff6-4a0d556d7060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:04.722597 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65ac3-cd3c-4658-8ff6-4a0d556d7060 admin admin] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:04.722884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65ac3-cd3c-4658-8ff6-4a0d556d7060 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:04.723157 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65ac3-cd3c-4658-8ff6-4a0d556d7060 admin admin] PATH_INFO: `/v3/roles` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:04.723884 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e65ac3-cd3c-4658-8ff6-4a0d556d7060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:04.725489 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e65ac3-cd3c-4658-8ff6-4a0d556d7060 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:04.739481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1447/2870] 10.222.0.23 () {58 vars in 1121 bytes} [Wed Apr 6 13:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 06 13:06:04.744183 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee874bbb-bd30-43ad-8a2c-5abbe38f4efb admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:04.755059 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee874bbb-bd30-43ad-8a2c-5abbe38f4efb admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:04.760241 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c49271-6b94-419b-946d-47a8929b2f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:04.761165 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c49271-6b94-419b-946d-47a8929b2f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:04.761444 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c49271-6b94-419b-946d-47a8929b2f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:04.761762 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c49271-6b94-419b-946d-47a8929b2f2c admin admin] PATH_INFO: `/v3/projects/93b44ec61bc148d9a4caa03337f9353e/users/6522847633d84445ac66edb4be6124d8/roles/c158bb1781c44a03890992161076b84b` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:04.764316 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c49271-6b94-419b-946d-47a8929b2f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b44ec61bc148d9a4caa03337f9353e, user_id=6522847633d84445ac66edb4be6124d8, role_id=c158bb1781c44a03890992161076b84b)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:04.767072 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c49271-6b94-419b-946d-47a8929b2f2c admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:04.781329 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1424/2871] 10.222.0.23 () {60 vars in 1482 bytes} [Wed Apr 6 13:06:04 2022] PUT /identity/v3/projects/93b44ec61bc148d9a4caa03337f9353e/users/6522847633d84445ac66edb4be6124d8/roles/c158bb1781c44a03890992161076b84b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:06:09.499182 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d8316-1bf8-43f7-8c9e-e06c3a25c559 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:09.499704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d8316-1bf8-43f7-8c9e-e06c3a25c559 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:09.499815 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d8316-1bf8-43f7-8c9e-e06c3a25c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:09.527060 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-3a9d8316-1bf8-43f7-8c9e-e06c3a25c559 None None] MFA Rules not processed for user `6522847633d84445ac66edb4be6124d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:06:09.528381 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-3a9d8316-1bf8-43f7-8c9e-e06c3a25c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:09.603274 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1448/2872] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:06:09.611723 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c49271-6b94-419b-946d-47a8929b2f2c admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:09.613508 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-f3c49271-6b94-419b-946d-47a8929b2f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:09.674991 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c49271-6b94-419b-946d-47a8929b2f2c admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:09.678778 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e3716-afaf-4bee-a6c6-e83d8c6f8601 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7330a81c0f3a496ea29ae911fcc69221', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:09.679445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e3716-afaf-4bee-a6c6-e83d8c6f8601 service glance] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:09.679820 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e3716-afaf-4bee-a6c6-e83d8c6f8601 service glance] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:09.680131 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e3716-afaf-4bee-a6c6-e83d8c6f8601 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:09.739808 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e3716-afaf-4bee-a6c6-e83d8c6f8601 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:09.741377 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619e3716-afaf-4bee-a6c6-e83d8c6f8601 service glance] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:09.750658 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1425/2873] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:06:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:06:09.873509 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37b462-ccce-498e-beb9-8b584bd87e47 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:09.873864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37b462-ccce-498e-beb9-8b584bd87e47 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:09.874134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37b462-ccce-498e-beb9-8b584bd87e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:09.901185 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-0c37b462-ccce-498e-beb9-8b584bd87e47 None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:06:09.902438 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-0c37b462-ccce-498e-beb9-8b584bd87e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:09.964208 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1449/2874] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 13:06:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:06:10.030389 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e3716-afaf-4bee-a6c6-e83d8c6f8601 service glance] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:10.031831 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-619e3716-afaf-4bee-a6c6-e83d8c6f8601 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:10.104650 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e3716-afaf-4bee-a6c6-e83d8c6f8601 service glance] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:10.109978 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb435c-b730-47c0-86df-5b05c576e983 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:10.110636 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb435c-b730-47c0-86df-5b05c576e983 service swift] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:10.111008 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb435c-b730-47c0-86df-5b05c576e983 service swift] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:10.111238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb435c-b730-47c0-86df-5b05c576e983 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:10.120826 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb435c-b730-47c0-86df-5b05c576e983 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:10.122489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb435c-b730-47c0-86df-5b05c576e983 service swift] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:10.131012 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1426/2875] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 13:06:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 13:06:19.090076 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df49d5-fa62-47f7-b655-e8925cdfd0a6 None None] REQUEST_METHOD: `POST` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:19.090606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df49d5-fa62-47f7-b655-e8925cdfd0a6 None None] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:19.090606 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df49d5-fa62-47f7-b655-e8925cdfd0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:19.109389 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.auth.core [None req-09df49d5-fa62-47f7-b655-e8925cdfd0a6 None None] MFA Rules not processed for user `1b4c270df37645698b3f92dd2714d2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:06:19.110680 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-09df49d5-fa62-47f7-b655-e8925cdfd0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:19.118554 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1450/2876] 10.222.0.23 () {58 vars in 957 bytes} [Wed Apr 6 13:06:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:06:19.390425 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb435c-b730-47c0-86df-5b05c576e983 service swift] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:19.391908 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-91cb435c-b730-47c0-86df-5b05c576e983 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:19.453081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb435c-b730-47c0-86df-5b05c576e983 service swift] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:19.456759 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2994bef-63b7-4300-b0d9-2b47b7f32b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:19.457403 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994bef-63b7-4300-b0d9-2b47b7f32b1a service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:19.457728 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994bef-63b7-4300-b0d9-2b47b7f32b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:19.458007 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2994bef-63b7-4300-b0d9-2b47b7f32b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:19.460033 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-b2994bef-63b7-4300-b0d9-2b47b7f32b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:19.470962 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2994bef-63b7-4300-b0d9-2b47b7f32b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:19.472430 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2994bef-63b7-4300-b0d9-2b47b7f32b1a service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:19.481599 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1427/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:06:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:06:20.825056 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df49d5-fa62-47f7-b655-e8925cdfd0a6 None None] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:20.826507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-09df49d5-fa62-47f7-b655-e8925cdfd0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:20.901789 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df49d5-fa62-47f7-b655-e8925cdfd0a6 None None] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:20.906832 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d87d9-80d3-4e00-9636-7ef23e768174 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221dab3ebc4f4c68b253729391e9c503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:20.907485 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d87d9-80d3-4e00-9636-7ef23e768174 service placement] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:20.907863 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d87d9-80d3-4e00-9636-7ef23e768174 service placement] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:20.908171 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d87d9-80d3-4e00-9636-7ef23e768174 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:20.910046 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-b66d87d9-80d3-4e00-9636-7ef23e768174 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:20.922350 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d87d9-80d3-4e00-9636-7ef23e768174 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:20.923967 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d87d9-80d3-4e00-9636-7ef23e768174 service placement] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:20.935507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1451/2878] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:06:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:06:25.152489 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c932e-a895-4b88-9e1a-fcee29d2fba2 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:25.153022 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c932e-a895-4b88-9e1a-fcee29d2fba2 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:25.153230 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c932e-a895-4b88-9e1a-fcee29d2fba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:25.171961 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-216c932e-a895-4b88-9e1a-fcee29d2fba2 None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:06:25.173175 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-216c932e-a895-4b88-9e1a-fcee29d2fba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:25.182014 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1428/2879] 10.222.0.23 () {58 vars in 1009 bytes} [Wed Apr 6 13:06:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:06:25.196942 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d87d9-80d3-4e00-9636-7ef23e768174 service placement] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:25.210682 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d87d9-80d3-4e00-9636-7ef23e768174 service placement] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:25.222309 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de0a36-cc5a-4942-8bb9-cd1665dacc56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:25.222997 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de0a36-cc5a-4942-8bb9-cd1665dacc56 service swift] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:25.223395 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de0a36-cc5a-4942-8bb9-cd1665dacc56 service swift] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:25.223593 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de0a36-cc5a-4942-8bb9-cd1665dacc56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:25.233864 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de0a36-cc5a-4942-8bb9-cd1665dacc56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:25.235507 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de0a36-cc5a-4942-8bb9-cd1665dacc56 service swift] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:25.248091 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1452/2880] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 13:06:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 13:06:33.243427 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c932e-a895-4b88-9e1a-fcee29d2fba2 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:33.252749 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c932e-a895-4b88-9e1a-fcee29d2fba2 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:33.256989 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf7ee6-48cc-4dda-b28f-0f6ac320822f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:33.257671 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf7ee6-48cc-4dda-b28f-0f6ac320822f service neutron] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:33.257952 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf7ee6-48cc-4dda-b28f-0f6ac320822f service neutron] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:33.258226 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf7ee6-48cc-4dda-b28f-0f6ac320822f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:33.260030 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-28bf7ee6-48cc-4dda-b28f-0f6ac320822f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:33.269779 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf7ee6-48cc-4dda-b28f-0f6ac320822f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:33.271224 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf7ee6-48cc-4dda-b28f-0f6ac320822f service neutron] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:33.279654 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1429/2881] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:06:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:06:34.181702 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de0a36-cc5a-4942-8bb9-cd1665dacc56 service swift] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:34.184452 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-a7de0a36-cc5a-4942-8bb9-cd1665dacc56 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:34.274865 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de0a36-cc5a-4942-8bb9-cd1665dacc56 service swift] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:34.280477 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a22fa-2a26-43c8-acac-9b1b2d6772ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:34.281138 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a22fa-2a26-43c8-acac-9b1b2d6772ba service nova] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:34.281425 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a22fa-2a26-43c8-acac-9b1b2d6772ba service nova] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:34.281739 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a22fa-2a26-43c8-acac-9b1b2d6772ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:34.283569 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-9f1a22fa-2a26-43c8-acac-9b1b2d6772ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:34.298236 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a22fa-2a26-43c8-acac-9b1b2d6772ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:34.299914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a22fa-2a26-43c8-acac-9b1b2d6772ba service nova] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:34.313088 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1453/2882] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:06:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:06:41.219647 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf7ee6-48cc-4dda-b28f-0f6ac320822f service neutron] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:41.221992 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-28bf7ee6-48cc-4dda-b28f-0f6ac320822f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:41.240901 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf7ee6-48cc-4dda-b28f-0f6ac320822f service neutron] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:41.246702 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584241-41c1-4147-91b2-6ea5c8e00166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:41.247361 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584241-41c1-4147-91b2-6ea5c8e00166 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:41.247645 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584241-41c1-4147-91b2-6ea5c8e00166 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:41.247930 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584241-41c1-4147-91b2-6ea5c8e00166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:41.249769 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e6584241-41c1-4147-91b2-6ea5c8e00166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:41.262624 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584241-41c1-4147-91b2-6ea5c8e00166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:41.264254 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584241-41c1-4147-91b2-6ea5c8e00166 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:41.275715 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1430/2883] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:06:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:06:52.005775 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a22fa-2a26-43c8-acac-9b1b2d6772ba service nova] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:52.014914 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a22fa-2a26-43c8-acac-9b1b2d6772ba service nova] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:52.018419 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cce53b-7744-4643-8df2-69a851a724c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bd327cdfe2c4f729252d86838aae638', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:52.019045 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce53b-7744-4643-8df2-69a851a724c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:52.019317 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce53b-7744-4643-8df2-69a851a724c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:52.019587 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cce53b-7744-4643-8df2-69a851a724c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:52.028617 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cce53b-7744-4643-8df2-69a851a724c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:52.030066 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cce53b-7744-4643-8df2-69a851a724c2 service neutron] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:52.039179 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1454/2884] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:06:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:06:53.881478 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584241-41c1-4147-91b2-6ea5c8e00166 service nova] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:06:53.903238 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584241-41c1-4147-91b2-6ea5c8e00166 service nova] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:06:53.909138 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea02251-de12-436f-ac6b-2014cac1d2c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b295446c7741ea96caf60ac955d82d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:06:53.909829 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea02251-de12-436f-ac6b-2014cac1d2c1 service nova] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:06:53.910111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea02251-de12-436f-ac6b-2014cac1d2c1 service nova] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:06:53.910390 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea02251-de12-436f-ac6b-2014cac1d2c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:06:53.912185 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-7ea02251-de12-436f-ac6b-2014cac1d2c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:06:53.936852 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea02251-de12-436f-ac6b-2014cac1d2c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:06:53.938609 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea02251-de12-436f-ac6b-2014cac1d2c1 service nova] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:06:53.957011 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1431/2885] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:06:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 06 13:08:05.062634 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cce53b-7744-4643-8df2-69a851a724c2 service neutron] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:08:05.064055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-87cce53b-7744-4643-8df2-69a851a724c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:08:05.145420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cce53b-7744-4643-8df2-69a851a724c2 service neutron] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:08:05.150537 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a589e18-55ae-4536-b3f2-0b0529b7e210 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221dab3ebc4f4c68b253729391e9c503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:08:05.152313 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a589e18-55ae-4536-b3f2-0b0529b7e210 service placement] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:08:05.152600 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a589e18-55ae-4536-b3f2-0b0529b7e210 service placement] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:08:05.152881 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a589e18-55ae-4536-b3f2-0b0529b7e210 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:08:05.154699 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-5a589e18-55ae-4536-b3f2-0b0529b7e210 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:08:05.168821 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a589e18-55ae-4536-b3f2-0b0529b7e210 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:08:05.171481 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a589e18-55ae-4536-b3f2-0b0529b7e210 service placement] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:08:05.190159 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1455/2886] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:08:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 06 13:08:17.358111 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72e63-7a83-4c53-af12-f5331cf859b1 None None] REQUEST_METHOD: `POST` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:08:17.358576 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72e63-7a83-4c53-af12-f5331cf859b1 None None] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:08:17.358683 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e72e63-7a83-4c53-af12-f5331cf859b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:08:17.415051 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.auth.core [None req-39e72e63-7a83-4c53-af12-f5331cf859b1 None None] MFA Rules not processed for user `dc8964c44ba54772b29ca1e584be8c12`. Rule list: `[]` (Enabled: `True`). {{(pid=86176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 06 13:08:17.416783 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-39e72e63-7a83-4c53-af12-f5331cf859b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:08:17.439840 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1432/2887] 10.222.0.23 () {58 vars in 967 bytes} [Wed Apr 6 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 06 13:08:17.480081 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a589e18-55ae-4536-b3f2-0b0529b7e210 service placement] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:08:17.501392 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a589e18-55ae-4536-b3f2-0b0529b7e210 service placement] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:08:17.507726 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa166f-b61e-4bf4-ba9e-135661851460 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0118661184dc4cb198f65e831fb1fe8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:08:17.508373 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa166f-b61e-4bf4-ba9e-135661851460 service swift] REQUEST_METHOD: `GET` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:08:17.508905 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa166f-b61e-4bf4-ba9e-135661851460 service swift] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:08:17.509186 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa166f-b61e-4bf4-ba9e-135661851460 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:08:17.517902 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa166f-b61e-4bf4-ba9e-135661851460 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:08:17.519799 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa166f-b61e-4bf4-ba9e-135661851460 service swift] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:08:17.529538 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1456/2888] 10.222.0.23 () {60 vars in 1384 bytes} [Wed Apr 6 13:08:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 06 13:08:24.147461 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72e63-7a83-4c53-af12-f5331cf859b1 None None] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:08:24.230975 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e72e63-7a83-4c53-af12-f5331cf859b1 None None] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:08:24.235445 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:08:24.236304 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:08:24.236585 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:08:24.236859 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] PATH_INFO: `/v3/users/1b4c270df37645698b3f92dd2714d2fe` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:08:24.238095 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b4c270df37645698b3f92dd2714d2fe)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:08:24.240041 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:08:24.286816 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b4c270df37645698b3f92dd2714d2fe'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.287483 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b4c270df37645698b3f92dd2714d2fe'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.288079 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b4c270df37645698b3f92dd2714d2fe'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.295227 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b4c270df37645698b3f92dd2714d2fe'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.306580 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b4c270df37645698b3f92dd2714d2fe'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.320081 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1433/2889] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:08:24 2022] DELETE /identity/v3/users/1b4c270df37645698b3f92dd2714d2fe => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:08:24.494644 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa166f-b61e-4bf4-ba9e-135661851460 service swift] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:08:24.504885 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa166f-b61e-4bf4-ba9e-135661851460 service swift] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:08:24.566824 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:08:24.567670 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:08:24.567949 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:08:24.568220 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] PATH_INFO: `/v3/projects/892bf9a242a641b3a5354852056c1dac` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:08:24.569371 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=892bf9a242a641b3a5354852056c1dac)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:08:24.571302 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:08:24.616384 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892bf9a242a641b3a5354852056c1dac', 'request_id': 'req-2e6f87ce-b7e0-489d-8311-4bebc4db9096'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.622933 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892bf9a242a641b3a5354852056c1dac', 'request_id': 'req-2e6f87ce-b7e0-489d-8311-4bebc4db9096'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.630776 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892bf9a242a641b3a5354852056c1dac', 'request_id': 'req-2e6f87ce-b7e0-489d-8311-4bebc4db9096'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.655837 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] The token cache is being invalidate because project 892bf9a242a641b3a5354852056c1dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:08:24.656078 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.656704 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.658282 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1457/2890] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:08:24 2022] DELETE /identity/v3/projects/892bf9a242a641b3a5354852056c1dac => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:08:24.662257 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:08:24.663688 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:08:24.677194 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f795c05-7987-4798-8fb8-70b195610175 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:08:24.733906 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:08:24.734773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:08:24.735056 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:08:24.735328 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] PATH_INFO: `/v3/users/6522847633d84445ac66edb4be6124d8` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:08:24.736516 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6522847633d84445ac66edb4be6124d8)` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:08:24.738592 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:08:24.783216 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6522847633d84445ac66edb4be6124d8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.783854 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6522847633d84445ac66edb4be6124d8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.784440 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6522847633d84445ac66edb4be6124d8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.791100 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6522847633d84445ac66edb4be6124d8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.801977 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.notifications [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6522847633d84445ac66edb4be6124d8'} {{(pid=86176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:24.815298 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1434/2891] 10.222.0.23 () {58 vars in 1223 bytes} [Wed Apr 6 13:08:24 2022] DELETE /identity/v3/users/6522847633d84445ac66edb4be6124d8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 06 13:08:24.993055 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] Authenticating user token {{(pid=86175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:08:24.995062 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.fernet_utils [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:08:25.010257 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f87ce-b7e0-489d-8311-4bebc4db9096 admin admin] Validating token access rules against request {{(pid=86175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:08:25.067273 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e20a973b647478db16f26c4e132ad3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ae146b1346144a8a304973b35877975', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:08:25.068134 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:08:25.068420 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:08:25.068698 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] PATH_INFO: `/v3/projects/93b44ec61bc148d9a4caa03337f9353e` {{(pid=86175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:08:25.069923 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b44ec61bc148d9a4caa03337f9353e)` {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:08:25.072339 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] RBAC: Authorization granted {{(pid=86175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:08:25.119065 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b44ec61bc148d9a4caa03337f9353e', 'request_id': 'req-feb851fb-4719-4c5a-aba0-e543a8a4e120'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:25.124993 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b44ec61bc148d9a4caa03337f9353e', 'request_id': 'req-feb851fb-4719-4c5a-aba0-e543a8a4e120'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:25.132263 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b44ec61bc148d9a4caa03337f9353e', 'request_id': 'req-feb851fb-4719-4c5a-aba0-e543a8a4e120'} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:25.143681 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] The token cache is being invalidate because project 93b44ec61bc148d9a4caa03337f9353e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 06 13:08:25.143968 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:25.144668 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: DEBUG keystone.notifications [None req-feb851fb-4719-4c5a-aba0-e543a8a4e120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 06 13:08:25.146268 dv-cinder-836769-2-iscsi devstack@keystone.service[86175]: [pid: 86175|app: 0|req: 1458/2892] 10.222.0.23 () {58 vars in 1232 bytes} [Wed Apr 6 13:08:24 2022] DELETE /identity/v3/projects/93b44ec61bc148d9a4caa03337f9353e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 06 13:13:14.074264 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] Authenticating user token {{(pid=86176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 06 13:13:14.076039 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:13:14.163259 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce46df-0883-405e-ad44-5681f4b33831 admin admin] Validating token access rules against request {{(pid=86176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 06 13:13:14.240638 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f3efe-b953-4a5c-900b-d9a9d84f6512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '221dab3ebc4f4c68b253729391e9c503', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bfa416e3db24ec3bd6b930f3e35f207', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 06 13:13:14.242093 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f3efe-b953-4a5c-900b-d9a9d84f6512 service placement] REQUEST_METHOD: `GET` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 06 13:13:14.242640 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f3efe-b953-4a5c-900b-d9a9d84f6512 service placement] SCRIPT_NAME: `/identity` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 06 13:13:14.243114 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f3efe-b953-4a5c-900b-d9a9d84f6512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 06 13:13:14.246356 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.fernet_utils [None req-e01f3efe-b953-4a5c-900b-d9a9d84f6512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 06 13:13:14.269029 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f3efe-b953-4a5c-900b-d9a9d84f6512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 06 13:13:14.272773 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f3efe-b953-4a5c-900b-d9a9d84f6512 service placement] RBAC: Authorization granted {{(pid=86176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 06 13:13:14.293191 dv-cinder-836769-2-iscsi devstack@keystone.service[86176]: [pid: 86176|app: 0|req: 1435/2893] 10.222.0.23 () {60 vars in 1365 bytes} [Wed Apr 6 13:13:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)